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(54) DATA COMMUNICATION SYSTEM AND DEVICE. DATA COMMUNICATION METHOD AND 
RECORDING MEDIUM 

(57)Abstract: 

PROBLEM TO BE SOLVED: To provide a data 
communication system that can readily realize real-time 
and interactive communication, that is complicated more 
than that of displaying a moving image and other 
contents, while being temporally synchronously with 
each other. 

SOLUTION: The moving image and the other contents 
are reproduced temporally synchronously with each 
other according to synchronization attribute information 
in the direction of time and the moving image and the 
other contents are reproduced spatially synchronously 
with each other according to synchronization attribute 
information in a direction of space, so that not only the 
other contents can be reproduced, while taking temporal 
synchronization with the moving image data but also the 
other contents can be reproduced corresponding to an 
operation instructing a specific position set in the 
moving image data. Furthermore, the moving image data 
and scenario data are separately prepared and 

separately distributed and a client side at a distribution destination multiplexes the respective 
data and reproduces the multiplexed data, so that the contents of the contents data can be 
revised on real-time basis, by having only to rewrite the scenario data. 
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ic £ d . ->t y *f- 9 * m # * * 5 £ ^ X' a V x V V 
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1.U9 T > h frb D-C±EHlBx-^ i: 

±M'y-r y a-f-* t £±e* u r v v \zmm-rzy 

lif-? k ±Ev"T y ^x-* 1 £±1EdT£©JSttfc 
T < £±EfWT-* i ±fB->-y- y ^"T-^ 1 Stta^ 
k ±IBv"t y t &'<rA>*-?'Ujrx LTilffi i"5 

mm^owimm\i\n^t . ±E»ii7-* 

3 <D{6JiX/!>> 1 5 lc|S«Ox— ^iiffi ~>*7 is 
[11*315] ±f£B#r^[S]CD^«Jgtt1W*«> 

ft 3 ±E»Hx- 9 f <75»fm^M IKI tf ffi 
■£arf-<fc1H*«^ ±E{igit$icj;<3^£ft5f4« 

[!f*ri7] ±|S-y— _kE?7-f T> hfrbm 

bftx< z^mcfczx±mi/i-v*y-?-$:mM-fz 
mmzG-tz r t t -raw 1 ~ 6 ^wi^ 1 

» t i"53»*« 4-7 ©{pHx** 1 gt^Eft^r-^iHf 
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±IEibHx — ^ ^ roffiro 7 u— a (- fc 5 ±K^-7' 
10 [M*«lOl ±E^y*7*-^4r±fi£i-5Rl-± 

[a*3Siu ±ie->T-y^-x-^*±^i-5^(c± 

*lR|(0|Sl»l«ttfflf#Sr4^i-5 ^ t 

[ff*iSl2] t-^t^7-<7yhi:W7 h!7- 
y i^Lxmrn^^m^ft, ±.mD—'<frb±.s&y 

lEf-^B, ±Byy-fT> hfrbowmcfccx, 
' %Wf-9 t ^mmmy-y-^ftLXtirffljjfa&tXfQ 
30 fflfifaimMLXft^l-^i&cD^yyyy k &istt=> 
>y>yy-9Z±myy-(TyhKm{ni-Z>y-?& 

1- 5 f¥4¥S Sr« * ' t k "f 5 x r - 9 ffiflT 

40 u^xummij^m^m^^-^^mmm^n 

i.tmmy-9 k±$m(o^yyyy k mmm^mm 
LxwsL-tzkk^ ±w.^m^^mmm\tmm^ 

^PJWLTS±i-5ri:*#ai:i-5ai*«l 2 i'E« 
of- ^jift^^x^o 

50 t, ±E^1f^±9*$n5^^5^^T-HtTl--< 
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3 £1E^£>X — * iiff WtA„ 
[»M15] ±3E^IW*l6lOPI»!JRtt1t«f4, 

£tL3±E»Bx-* * ©»fm^WISr*i-l* rait 16 

t , ±e$hhimr£ 4 t> ^ $ ft 3 7 u- Art <D&m<r>tiL 

[tf*9ie] ±ia^ra*i^roia»i«ttttfa*5<tt5± 10 

m n hit -y-r v *x- * ic t. <o m& is *u 

±tm -hfBitiu^— * £ ±f^>x y $ 

k £±|Bf— U ilEtWx-* ir±fEv"r 
y *x*-* H^f^un LTSi1-S r t 
i-f3fif*9i 3-1 sro^tt^i^SEftror-^ii 

[IS*9l7] ±fEx— ^14, ±15^7^7^ 
P>ftT < CT±fe->x y *x-* SrlBfti - 

~i£#®£-r5ff*9l 6 £|E«ttf>x 20 

[it*9is] *vb7-?z3rLxmm£titzt>7 
- * sriEiti- 5 ->-t y ^-Eit^a i . 

±m?y<<Tyhfi^ CT±fB»iBx- * k 
±fS->x y *x- ^ ir §r±ta ?vJT>y \z.m\tirz>?' 

-trnm^km^tzzkmrnk-tzy'-tmim 30 

So 

[tt*9 1 9 ] ±|E->x y *x- * (4, ±ta»Bx- 
9 t i&co^ >x W k %!%f$\mzmW tzHb 

(omrnjj ftnmmm&fiimk. ±e»iBx-* k±tm 

*Sl©lRl»JHttfll*i^trri:tW«i:i-ai»*«l 
[11*92 0] ±|EBBIElt¥Sj3j;Uf±|Ev'xy^- 

"bft 5 ^£#^1-611*91 8*fcW:l 9[cfB$c<7) 
x-*ilfi£§g 0 

[11*92 1] vy-9*ftLxmm.ztiti>?y 

4 rv Y £ftB£^trxW££mi-£x-*iI{lgg 

T'feoT, 

LT*M*l«iI*J:lJ^IB*lRlKiM)£oiHI**ttSr4-*.* 
->x y ;*-x-*£±fBftBx-* £*(-±fE^7^T^ 

x-*«mm, 50 
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[11*92 2] ±12^7^7^ hfrbmbthX< 
ri:Sr4#«i:i-5ffl!*«l 8-2 1 rofsjft^ 1 9t'iait 
[|f*92 3] *y h>7-^Sr^LT^$tt^- 

51if-^ t >x y7 £ *B#KWi-IWIW LTS 

i-zft£^mzmz-tcz\kZ¥fWik-f?>7*-*mmm 

[ft*92 4] ±E^*lRloil»IJIiffiffi#l4, 

k. ±mmmftmz£v*£tiz*j zisyx-nn-t^ 

# idf^ ^ - Kaffir* k&fstozt zftm k-rz I»*9 1 

9-23 wfsiti^ 1 9tcia«wr-^aff g» 0 
[ii*92 5] ±.u£ffljjfaivmnmmmx w± 

i^r^tJ>r irSr#mi-r?>lf*9l 9-2 3(75fsj^^l 

9tia«»x-^affago 

[f|*92 6] f— ^t^7^T>ht^^^ }.T7_ 

ft f 5 r- ^ »fl * ffiT-fe o -c , 

WimT-fk, ±fE»Bx-^^LT0r^©JRI4^4 

iSvt!) ^-x-^ £&J* i^±E-y— ^±tCfflS L, 

±ia»iBx-^ k ±ia->r y ^-x-^ t £±Ef—^ 

T±E»Bx-^ t iE'/t y ^-x-^ k ZlMffifcn 
miKU^xmZilrZXolzLtzZkZ&mk-fZT- 

[ff*9 2 7 ] ±tav/r y *x-*{4, ±ie»Bx- 
^ t ftn » 3 >x > y k z Btffl w \z. mm l t s <k-t 5 * 

yf>7 fc 4r^^«Ji-l^ffl L-Cff^-TS/c: AcO^K^rt 
cDlUMJSttttfai t ^#mi-r5W*92 6 \z. 

Eft^x-^afi^fc 

[ff*92 8] ±faB#W*fS](73[gI«St4tt$6f4, U£ 
$ tt5 ii|5»Bx- ^ f CD »)^*^B#ra Btffllf $8 

t «,f^ =3 - k rotf « k sr^tf r t t -r 5 If *9 2 
[»*9 2 9 ] ±.m£.ffiUfaommm&®ni*, n± 
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ktSttZ b&imb-f &ft*J&2 7Sfctt2 8|:Ei 

[^93 0] ±iEsra*iRi©pi»iJittfflra*, ±ts 
»Wx-^ Sr*jRi-5#7 U" — a r t ic^-rs r t *■ 

^«i:1-5»*«2 7-2 9 <D{pJtL;6> 1 SCgt©f- 

*am*& io 

r t ^mi-rsff 3 o msitwx-^afi # 
[ft *3j 3 2 ] _kta->7- y ^x-? &±tfttz>mz± 

#®£1-5f##gi3 HcEftOx-^iim^o 20 
tC-hfEv-r y *7-9*±MV~ '<frb±M?T4T^ 

#mi-r5ft*«3 1 tcfBftw^-^iim^fc 
if -f 5 ? - 9 aft x h o x s 

±|E^7^ry Mcfci^T, ±lE-!f— ^;&>6i£6;h/r< 
6*i/r< sftiif*-^ tffiroa^^yfcSri^iffltttiHi 

^aftm, 

M3 5] ±fSPfW^^o^JSt4tf^li> S£ 40 

k, tmrnmrnzzv^tstiztj ^y^xmni-^ 

[fff*«3 6] ±ffi^lW*I«0O|§l»iJRttflt*«:, ff± 



#582 002-176638 
6 

v h a»p>©5*i;:jc ct±e»Mx*-* t ±e->-7- y * 

x~* t £±fEx- /<j&»fe±B* 7^7^ Hc&ffU 

±ie^ 7^f7> h (r^T-tiaftiifx-* t ±te->x y 

-T5f»*3l3 4-3 6»{5TtL^l^fc|S^cO'r-^afI 
3 8 ] 11*9 1-25 1 JK-IB*© 

[11*93 9] »*«2 6-3 7©fiT^l«l-ia* 

w t* - * © $aa^ m z => > t 3 - * k nfr s * 
a * co -f a y y a £ f as l fc r t * mm t -f 5 = v f 

[0 0 0 1] 

[3£fi roJS-T 5 SW^»] (if- ^ aft v-^ T a 
7 h->x7t»5tft©7 , p^7A^EiLfc!2g 

xmmr'- 9 srem-r 5 x- * ait v*^ a (-ffl v ^x& 

^Ti" 5 •7"— -fA^r v tlcio v >T t » ii*: x A T* 

[0 0 0 2] 

Zlt-LX-V—^frbyyJTyhlc&m mm SriEfS 

DN (Integrated Services Digital Network) "Cfi^ 

aft5i«^6 4Kb p s km<* ¥-9mtm^^ 

IW*i!flM-aK:ttJI**:i*lll*A>a»oTL4 5o -t© 
[0 0 0 3] — ifi¥"<?f±, I SDNCO^+fS^iSii 

am*^i--5*ittit©aft-r>77ASiifii$tfct-c 

m^tamf— 9 zmmm <d 5 h i^mt lx, 97-17 
>hmxxj*-xtew±w@iZft5zk&»imkt£Z a 

[0004] tfc, aatfb^Tv^5ft®iaffro%t' 

ti, t-/<»f,^7-Y7y Hli|{--*atTW(-¥tcS!) 

4*6, w&Lx\,^w>n\z.mMLxttmmti: 
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rfcaST**ttf, tffjWRSI-**? M££©3tLV^4t 
[0 0 0 5] 

SMI L (Synchronized Multimedia Integration Lang 
uage) ^HMML (Hyper Media Markup Language) ft 

M<Dmm&*abtix^Z> c tit. fti£t?ft, I CML 10 

(Intermedia Casting Markup Language) tV -1 5 Want 

mz^xm^i-zm-mz^i-z-smxhz, 

[0 0 0 6] Lfl»L&#f>, rixfo<©wI§Ti±, ibHt 

llffeofc. I CMLm ftB^ff^^fcwx 
7 =i y x y y <75 1 *>& F/T a© t © £ ^— x I- fflJR * * 5 

ymitzmm-rz z t immxh^tz 0 

[0 0 0 7] Tftt?^ ±3*»#WST*»±, ®mttk<D 
=2 y^yy t MmwmMZk ZZb m^©^ 

gMLl-Sft^rogSgH^ft^ofc:, |=fc, »B<7> 

if-rsft if©>r y* 5 * r ^ ymitzmm-z z t \tm 
mxh^tz 0 

[0 0 0 8] ±i£<D#WMT*J±, BfPW^ffl*- 

$ y ^TiW tj|©3yfy7i^m3yr>'5' 

■C # ft I/ ^ i fe 5 £ v * 5 PpSW h o fco 
[0 0 0 9] ft*5, ->3^>)x-^ !)7;MfV7 

ti¥.<D4v$7 ? 7- j y&oh&wiMMTF^ yy- yy t> 

fcftfSo L>U v/3 y*y:c-:7Tii»B{^<£>x 
-^MAl:4otL4 5 fcV*5IMBa**>"K !^7;M 

ftBHfii^ yxyy i:£^y=<- KLT 

x" t^jg-r 5 r. t a*-? t ft t v ^5 PbIH t> fco 7i„ 
[ooio] iift-f y7 7»^Si-#oTi(iBia 
ffi < f Uffl S ti5 i 5 K ft 5 fc , itiW i ffiw 3 y 
ryy i: Sr^{^WW{-l^»!S-B:TS^$*5^fCft 
<, y77W-f Kfr^y? y yx^:/ftilff£ HSf 
5r i^£T*Tg*£;ft.-T< 5 0 L«»L4*fe, rax 

l^ft/^ofco 

[ooii] rroi ^ftHtitfC^Tj&^tl 50 
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®wtm(D=i>7-yy tzmrmizmm 

5777-4 ■/ftiift *Wai-HS.T'# 5 J: 5 r i 

[0 0 12] 

±.sZ J V—'<frh±.9&*7'(Ty 
h fctbB^ttx"-* £gef» -f 5 J; 5 Kft £*L?cx-* 

iiff-y^xA-efco-c, ±iaf— ibWx— *£ia 

«1-5»BfH«^Si, ±E»Bx-^lc»LT3f^W 

Si. ±ta^7^7y h^^cog^ioscriiatdBr 
t ±!E W- y t ^±E^ 7^ ry h (c^ff 

■fZT-f&m^gtkZffix.. ±fE^7^ryhii, ± 

ffif— t>^T < 5 ±IE»Bx - i: ±IE v T y 

[0 0 13] *%W<Dik(DmmXl±, t-/<^7^7 
ffi-y— /-<7J^±|2^ 7^ Ty Mc»)B*^ti>r-^ SrSE 

mi- -s i 5 t-ft $ *tfcf*- ^ m^f^tfe o x. ± 
tsf— ±fE^7-rry hfrb<DW#\z&cx, m 
if-? i %mm=f-t \cm Lxftfflijmis xxi^m 

l5fa\cmML,xm>iL-f'<$m<D=iy7 L yy t^ts^y 
±ffiihBx-^ i: tui&o^yT-yy t 

[0 0 14] *fc, *«W©x*-?iiflrg«fi, h 

7-^ zfrLxmmztitc? 7 4ry\ \z.mm*^t2T 

©fitt*4-x.5 -yx y ^x-^ ^e»t 5 yx y 
x-? fc ±Eyx y^-x-?tSr±£^ 7^ ry hi'iS 

m-r 5 x- ? inm#© t ^fii x.tc z. t t -r s o 

[0 0 15] *^BJ»ffi»|g^-r'{±, *y Yv-yikft 

Lxmwiznti? 7-( ry hizmmzt&T 1 -? znm 
t57-?iffgitfeot, ±ia^ 7 -cry h*»e>co 

*^t'Fyf^l^MJRtt^^^ 5 ^>x y *x-* £±8Btt 
Bx - ^i*i'±fa77yr>h t' ilff r 5 x - ? 

[0016] ^sswro^roflfewm^^n, ^7^-^ 
4rS»t5x-?iimseT*fco-c, ±Ef— ^<*»e>ise> 

fix < 5 ->t y iff -9 wH#p B ^iBiro[B]ffl«tt1f fftic 
lot, ±Kx-/^^iifetLT< SftBx-^iflfeW 
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t^-^b^bflX<h"yf')^~9^<D^Ml5^\ 
[0 0 17] *3£f^x-*il{f;£?£f±, 1J— 

mtzs-^ "y-r y t &m \c±.uy—s<±K 
v iz fcv ^x±mw}m7- 9 t iM's-i- y * t £± 

[0 0 18] *^B^<Df4.»#.^Ti±s f— *k9v<<7 

yht&*>? hv-**frhxmm»imcm&£tiit~> 

tiX < 5 1* Mr- * i: ffiro ^ > y t &m M W ih w 

\zmm <t 5 k. utr t t-r^o 

[0 0 19] ^^syt^-^K^^ts 

^IBflaiflcH, SH*3S 1-23 (Dfttlfr 1 5(-IE«<7)«- 

i», fc3W±, 2 4 ~ 3 5 ©fafta* 1 EfcfEtt© 

r - * iiffi^ft O&SqMW £• = y bT » - 9 \z%fs £ * 5 

[0020] *«Wii±Efitff#aJ: t)*S©-e» BfW 
*lRl©R«JlttflMltttoT, »Bx-*il$f?Blttf^ 

ffiW^lRirolRlJIBHttWWf^oT, ft 

•cflfeo = ^ £ff £-f 5 r t pJtfe 1 ft 5o 
[0021] #3&9!<0te<&ft»li:.fc*uf* SdPix 40 

-9t tmwimmmmz^t^si- y *^-9 t m\* 
£ *vc#j* \zmis £ *u salt 5t<» 9 y^ryvm 

*m%&^ztirtx^>Tyy(Dfo®zw%.-rz> 
[0022] 

mi$i/XTj>><D±#<Dm&m&w&toiz7ji-rmx'hz. 50 
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[0023] m 1 i-^-Ti 5 ^ifeff^Wx-^ii 

fgv-xxAn, w y '< 1 , »ehj— ^2, =>> 

(^yt;^yta-^/j:i:') 4-,, 4-, £{f 
-CV^ 0 wtbb»-y— /^*3<tU5^7-l'TVM~4fi, 

4*9—*? yy-v\zL^xmm.£fox& 
m^\z7-9<D&&m*'fibz\}iftX*%Z>$ioKt£ 

[0 0 2 4] ^ 2 H\ IllDB (x~ ^^<— 

X) 7 £«tx.T*5 >9 s rtDibHDB 7{C^#$ix-CV^ 
#aro»)PI?r#^7^T^h4- I , 4-2 36>feOK*fcfl? 

•7— ^ Sr^LT»H-9— ^ 2 tteSl^tiTibiiD B 7 t' 

{*#§tl^o »We*©a^3-Ktt, MPEG (movi 
ng picture coding experts group) , AVI (audio v 
ideo interleaved) , MOV, WMV V -t (Dfa<D if <DB 

X.iziyW&njmx'hz. 

[0 0 2 5] irf y ^-D— /< 1 tt, »WC»LT0f«® 

r©->t!)tDB 6tr^#$tl,TV^-5 1 !ZX±<Dis1- }) * 
f-9it, fMDB 7^{*#^h,TV^ 1 Jil±WSiBT 
-9\zZti : ?tiMfc-fZ h <nr-ib *) , ftfctZWf— 
9tmz9y^7>YA-x, 4-2 $H5„ ~^^> 

•^y^-x-^t. 3yTyW7^7yh3l:iO 

y 1 (-Kill $ttT v"t" y ^"D B 6 l^f*# S 

[0 0 2 6] ifBv^y^X-^ti:, KllittecDayx 

1 Sr^Wf-Plffl LXK±-tZ>tz$><DfHm nt , 
[0 0 2 7] ^#cD^W*fpl(C*ti-5l5]«m+±it 

\ztti-z^-vfrb<Dm^*\zfotxnfri-^mt 

[0 0 2 8] ±ffiB#WttfS{4, ^Jxtf, »HSr«*i"5 

m-tmwMnizj: vm&xzz, t.tz, w>ft=>-h~en 
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hf~?, URL (Uniform Resource Locat 

or) , HiT-r^t^P^Aft^iUW^-T?^ 5„ 
[0 0 2 9] *HJ6^ji-Cfl±, KlC^1-5 

$L-CHtT -tfcfcfe, *HJfc^ffi 

[0 0 3 0] ='^y->yftl$ l 9y'(T>h3&£X}&9 

T^h-4-. , 4-2 it. ^WiM\t-ii^XWiiytzM 10 
fflyi/- t8Sr«x:TV>5„ fffl^i/-t8li, W-y 

*-y— ^l^^iEft $jit< sw-y arf-^b, mm 
xv^o ibBx-^w- y tf-^©ii • 

[0 0 3 1] 5 f-fllJ&Lfcx-^ilffv' 

T>h3(^fc^T x #^7^r^h4-, , 4- 2 [ciam-r 20 

^®my-9k^ih\zftfc.-fZ>i/-ryiry : -9 k SrB'J 
^{'^1-5„ LT, ^ixtfflf-^^^jim-y 
r 7 - 9 LT ftMiJ— /< 2 is J; tfW" JJ /<1 
rwftBx-^^y *7*-9<Dft&<r> 

[0032] /< 2 Jo it/ y /< 1 k:» 

& $ fitjmf- 9 k ztiicttfc-t z -y-f- v 9 

tt, #^7^7yF4-, , 4-2 fcfllfc&ftfcSJBTV- 

1 8i>f>©E<sl*;(Si:t#^7^ryf4, , 4- 2 30 

icgEffi£ft3 0 *LT, ^fflTV—fSicJoV^ fbS 
y< li>bmbtiX%tzi/7-}) Jry-9 k tf-?/u?-fu? 

x£ftxm±£tiz> 0 

[0033] z<Dt£, mm-fv— y8«, iBft^n/c 

I^W^lRl^i-5lRl»!JRttfll»l-^oT, S^^WBH 
£ 9#l?Sl&&P]«l& £ 5 btiL<D ayf/; £K)B £ gij 
^-f^K^tStfciv^/fti. 09;tli, KB tic 

<yic^i-z>zk?£k°j)^mxhz> a *>*>5Aa s^f 

<0K)BtlRlffl^-a:"C*^-t-5flfe<D3^T>-^f±, KBi- 
Ha-fSflMIMS&T, iW£P^itt»ftW£E?>tP8 

[0 0 3 4] tfc, mj$y°ls— V8li, fBlB<75ff£ t f 1 

0 fit* £ ftfc r £ £l£*fl Lfc £ # fi, ^ w{4«lcMiSft 

it & ftfci&ft = - k \z. ft o ttt<o = >- y m zmm k 
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fe 5 9 4 5 > ^'T*«^ £ *L5 Sp°p <D{tmz~>1- V Hsry 

-9 (D^m^^n-r^^mm^m^^^x^Lx 

p p p(75P*PHf fft^rB'J * -f y K-7 r £ ft Ztf*im 

[0 0 3 5] H2fi, ^7^7yh4-, , 4-2 (DM^M 
ffitDmZ^-fMXfoZ,* 0 2iI/ftPit'lt 4>9y9 
■ 7°U— J r<Dm*V'<> K!> 1 1 . b©7' 
9 VK?1 2, ^'y^if'^^^K^l 3*S±tJ« 

-^rco-ftko -f ^ K£ 1 4^^$tbTV^5o 

[0 0 3 6] c^(D5'fe>^ 4>9y9yj7 • 7"u- V© 

£> tbBw#ML, -NFfltJh, ffih, 

^■f-SfcfcroSk^^^i 6 k, »H£>B*WWftW£{fi: 
SSrm^1-5fcftcD^7^i hv<— 1 7 < ^^^i^TV^5 0 
S)B*S4-t-2>£, K^-l 7©A-l 8^s 

frtttik^kwmnfttmm^ttx&x \mm lt 
«aw^fta»-f w £ m <fc *) , ftE©^^p,i(iB^f?4* 

[0 0 3 7] El 2 <7)W-e»)B**fl« l 5 icii, WB^ 
<75fe5^-r 5 V9X\ 7 U—J±$m^&KtcytWfi7F£ 
tiX^^Z>e Z(Dk%, y** VWyfir V 4 > K-> 1 
2{Cfi, ^!l^(i*^^y'l/-^B^»rtW%^-fx= 3 r^ h 

■7- y tf-^©»ir B wsi!:»t5 i^fflmttlf ffiK iot 
^X&fe£hZtk<D=*i'y>y~fc&^&ix2>a ®2(DM 

x-it. ®myK%*£httm*%x\<^m<D7*y>h* 

[0 0 3 8] ZCDM2(D$\X*7*y > V *} I 3\Z 

m*£tlX^Z^>T>y\t, M'fii<D'7xLy*y*y<?-?X 
^LZZk&'tfMftHTML (Hyper Text Markup Langua 
ge) |IJ;57x73y7^ (fc5URLC!?i^- 
v>) T?*)5o w©HTMLflMlf>fcllfeilfc/W^— !J 

y^gp^fr-v^^^ y y 9Ki.vmM-rz> ~kX, y> 

? 9t<D^my" y v-fy 4 > Y y i 3 lcm^-f Z> z k i> 
[0 0 3 9] Sfc, ftB**^i 5|c:S*£tt5i)iB 

\c%-tz>mmmmmic£-ox¥fj££ftz 0 m2<Dmx 

tt, il]B c ^ 3 i'a^St^fc^t^#^t-rv^SB#f+gl5^>^* 

■nmm®, 1 9 ^Pfl£frroi^$ji*i4t# fgd iotM 
$^^-cv^5o ;©#SJtifc^i«i9©M*v7 
*»m£± ^m^-rs£, ^m*i«i©pi»jittfl!fauc«t 
ot! (Dtmmm 1 9 ©<a* (- «■ & ^fcttft = - 
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[0040] fc*s, zzx-\±£ffljsfa\£mMi-2>4k<o=> 
VfyV^y'yyfy^yYy 1 3lc^-f5£ L/c 
S'JW $4>YV Sri*>±tf i 5 LT fc 

[0 0 4 1] ttc 02 0)fln?l±, KlW*^ffi^ 15t 
tt77^>'3 ^#"^^2 o ©ffl&&-£4-£5 J; 9 

■t, 5^-p*f*-^©a»n*iRit»-f5iBi»*ttfl!f* 

[0 0 4 2] ^©i5(;lli©- SSt LT^$txfc7 

^(fironyfyy (la^-ar-f) ft-yyV-fyj ^ko 

^If** ^K 1 ? 1 3 ili^?^ yK££:£*>±»fT 

[0043] 12201, 77y^'>3y*"^20>L 
O Linktf"^, Lively, Link2#^, Info#* 
V, Next#*:*'«:fl|;*.0*3 D Linlrf^&Jlt&intt 

fcSrJt*-t-5fcJ6<7)^^^ Livetf^Wl, 30 

[0044] 5 l^HJHKffiOi, itiBS*®$ 

9) fc#LT#71^Afcfc£W#fl0>ra«Mttfll#«: 40 

-s-jta^fcfcpTH-efcsu ttBroff^f^tid^w 
Way 7 y**^y2 o<E>ffi&&8jffi f T , fc.S^c? 

-?*>*,, ZLX, h©JSg«*l 9*3 

£.Xf7 7^9i'B^Xf'>2 0{ZttLXlim<r)W}ft=>~- 

5. 

[0 0 4 5] @3{i, igitc^ufcv'-T-y^-iJ— /<1, 
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7*o s/^ElT-fe5c 03Kl:i3t^O K)Bf--^2{i, Si 
BD B 7 CDfttLl^ ^f-/3 1i, ^RtfTCP/ 
UDP (transmission control protocol / user datag 
ram protocol) £ £ 5^ 7 3 2 J: SMix/Cl* 

[0 0 4 6] Ji^f-/<3 1tt, HfflTV— 

JSCO *OS*^a-i£-f5»Bx-^S:»liiDB 7^ 

fb^m-rMs^???, »HDB7*»e>si9fflsn*i» 

Sf-^ll, TCP/UDP©yy?7i-732^ 
Ltfffl7"U- ¥8(^11 £*t-5 0 4*5, El^OiUD 
P£07°n h =i/U&ffl^O N 5;6*, I I S (internet inf 
ormation server) t£¥<Dttil<D7°n ha/Hrffl^ttl 

[0 0 4 7] 4fc, i'tytt-^lli, ->t!)tDB 
6©flfcf^ y d-iJW*lJ«l«|5 3 3 , DBT^-i?*gP3 
4, j> 7^7^ h • 79±^M^3 5tSiXf r y"t D Jr 

wmmmm & *m*.x^z. v>-rv*Mmmm&3 3 

H, 9y4T> V • 7^-tr*Sffi£fl3 5/!>>6>ttf££*t5 
v-r y *7*— # £DiiJtti5*[c^oT, W9*DB6 

[0 0 4 8] DB7^t^S!3 4ll D ^iUa^Jft 

gp3 3&±x*i/i-y*mm.fflwu3 6*»&«H^»tao 

T, ->t!)tDB 6(cML-Tv'-7-y^-7 : '-^»l5l^-Wb 
fc 5 v ^fiS f ii^ ^rff 5 7c * © 7 ? -fe ^ 5r Hffi" 5 . 
[0049] 9y47"yY • T9 J t*fflW® 3 5 |i, 3? 
ffi7l/-t8®TCP/I P4 3^b^fetfr< 

K^-l 7«)»f^tJ:5»BS±H!*6&«ro 

»«fU -t©S»S:^y^l"JWlli | J»W3 3*3iV^ 
y^-*B*M»«P3 6l^i5. r^lciip, H)BroB#rfl 
Wffi{iBl^*fJS Lfc v"7" y *T'-9%m*tti LXm% 
yv-^SWMt Lit*), is-TV * J f—?<0**t:LtZ. 

[0 0 5 0] y ^-«*i69»9J 3 6 li, ^y^T^h 

»*S#W*o-r, ■>tytDB6C«#t^->t!J 

[0051] %%y°v>— Y8<ommzi$\,^x. y 

r^SfciSBS 7fi, i&Bf— /<2©!>i7't- ^3 1 
^*fLTBFfM»*)B7r^^©K#^**tll^L, 
J^^t UTCP/UDP©^y^7i-73 2 ^«biH 

ib,tiX<5Wimy7'(fl'&B%-&tri><DX'h6a b'<r>W) 
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[0 0 5 2] ftBx3- KbP 3 9 14, #gtSfl 3 8 
£tlfcftB^Wwj±$|&^3- K^t^T-feS, ^ 
K«P4 0f±, ftMiftS 8XftM£ft±%P7- 
9<»J±ffiZ7^- K1"5 »pi^ = -K«P3 

9 -e^ => - K $ tifcftBx- * *^Bffi (02 (Did 
B**M«1 Slcfa^-fZ^ft) 10 

[0 0 5 3] rtl^WiftWr-^fcit^^x-^^xt 

frhz, W)m®m$$4 m, z<D±?icwim7^-m 

3 9 48 £1*^7*7* = - K»4 0(7)fiJp^tT5„ ft 
5ffl#Ftt4lB, ^**M^#*rBlS4 5KJ;!J#*lr£ix 

44f©18*K*^ Hv^-i 7(7?^fticJ;5ftffl 20 

[0 0 5 4] iffiftWf* 3- KSP 3 9 ± •? tfj^tt/cft 
Hx-^^^$tl5Bffitt, ftBJi^ U^T •¥ 4 2 a fc 

■v^^&EtfeWWir4 2 b tSr^-e*ritS^5o ft 
Bf 3 - 3 9 tf 3 - K $ ftf'ftBx- * [4, ftp 

U--f "V 4 2 a [~^£ft5 0 jc*BB-t<£>{£ 30 

imtnm^tximfem wr + 4 2 b^-ctta^, 

■r£*ftf13?*rlS5 4 5 (Ct±!^£ft5 0 
[0 0 5 5] TCP/IPCJ;5-fy^7x-^4 3 

tJM^#^^i 6 <fcS»B<off^ 

tlT< 5 rt^-^&gft U -tWflC&iiia* 40 
[0 0 5 6] "7 ? ^ftf^jHW SB 4 5 i±, ^ V *ft«tfeffi 

w + 4 2 bicT^w^ti/c-^^^^wfasjHitfiB 

ftBWSM l^bW^StiSff^raifStfcS 

f^asfTfeH*:©*^, n±^<Dmm<Dk'(D94 ^>9x 

[0 0 5 7] ftfftiftlgM 614, iMJPtM 1 ±UtU 50 
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$ttfc^^^*ff©rtSfc, i^S8«H4fflf*3a«aJ4 4^ 

g|2<£>:7'7?f J ?-f ^K?l 3[1^1-?.flfe<753i/7 i >^ 

<73*^ft^, mmR^yJ7'1&m%?(DW)M7-9~<n 

[0058] Mrfcmuz, ft^j»gp4 6tt, mmufa 

%ifa<D=iyT>y%-7yV*fV A isYV l 3 iri^-fS 
J:5t-iH»1-5. ftftfHtPSfU 6 i4, 

<nMffift®b£mxfa(DmMm^ubizm^x, a 

tLfcte©3^x>^lry7'?f i '>'<>' K£ 1 3fc£v>(4 
tiL(DW)m7-9 W'} a y W 1 3fc5^f4ft® 

&7F&m 1 5 4? iru^-r 5 £ 5 c«#r*-a. 

[0 0 5 9] ^±©£5!', *W&&B(07—9miii' 

4rt^HI«UwPHJIS*r**i-5fc*oi*IB*i^t»i- 
SlUfflJS+iltfgt, ftB^roffilrro^v^ ^77 

y^->3 >^^^[C*ti-5te»lt^t-[RlfflLTfi!lCD3 

t*i-*B»llltt««i:*^fc*^ y ^x-^ ^ftB 
x-^ t*f*E(ti-5o ZLXy &W7-9 bis-TV* 
7-9 b m±mx^^7y°v^ 7, LXn±-fZ i. 5 \z 

[0 0 6 0] **ffi^(rJ;tL(i, ftB!' 

t5r^Wtl^»!$-fr-C**i-5^ftT*^< > ftB»* 

5 #£$ti5ftn» 3 ^ftpi t mm $itx$t&t 

oS^ H^1-5ftB('^»1-5ftE 
(#Jx.ff£T) <Ditf*S*.9 Y\z.ft\,X*s73 JrVLi.*) 
m^^-^xmt-f^^b LT, B#ffl*^ro^»Jt^ 
IB]^©ftW^i-5lfl«li:«rllSi-Sr.i:*S"r«i:« 

'So 

[0 0 6 1] Sfc, #HJ6^!i-C*tt, ®m7-9\tZi% 
«rfe#*U ftBJS+4^4^.5 ->-^ y ^'-^ ^ftB 

^ >s7y*7-9znmirz>tmx*®$ ] \z 
mn-rsr tj^-etSo rwao, ^raw^v^^ 
t 1 ^^^, ^ y^-eftBtfifero^^^^i 

asRJBi-* J: 5 ft = ^ ^> 4 if t ** icf^ritf 5:i 

B^gSiftt-ff^, -S#f#it, ^il>9, ill 
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[0 0 6 2] ftJtEH, t>bfrZ#>&lbbft1z9hm 

j5r£tf>Wl§T-fBj£ LTtlb^^ £ o Tfbpj i: fife© ^yfy 

[0 0 6 3] dttfcMLT, *IBBP«THt, »HtH 
tm l ft ywflt© 3 y x >y t * * m u^/vxmn £ * 

5r i('£oT|5]$£i£5ra-mft<, ibBi^coijB 10 

Hiot, SdB £ fife©^ ^x >y £ £ff £{IJT|iJ]»j $ * 

[0 0 6 4] rfttri^ *HifcMffifwJ:ixtf, SiBi- 
f«P LT«^i--5ffe© = vyjf ${±, HI^Eff $ 

fcSfcifci;:, ftBros^-efco-ck, (=» 
[0 0 6 5] (Mi) Si^^fyyfW^fi 

H4fi, *gSf l^ftffl yryy^->7 

[0 0 6 6] 0 4f^i-«t5t^ ^a^fy^'Mv' 
*X.M4, UtO^yf^M^^^T^ h 3- , 3 
- 2 , 3-3 Y9—?*'frLX*ti : ?1ni'-ry*V- 30 

[0 0 6 7] 0 2H^L^^jiffi<7?5*5> 

itiBS^m^ i 5 \at, mw^yfyyft&ty^r 

yf3-, , 3-2 , 3-3 T#|S5ILTffr8-«*1-3*liIifc 
**-T5o y^X^^K? 1 3(Cfi, 

Ty^M^'fjyfa-,, 3- 2 , 3-3 w^-if^g 
* 5 1ttb<D^v y Y Bffifc 5 v>Ji fft^ 

gOTB^SrS^-fS, lofty bBB^Wu S)W^ 40 

Sipi-L-cb^U KB7u-i>.^<75#^<75f4S^ 
[0 0 6 8] rwi?^ ^-fv— ysftffiz-ZV 7 

m^mw^m'tKDm^^-^ 8 -r-*a»S)B 
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[0 0 6 9] Slli, iticroM^^itlBlT-sVx^^ 
Kf^U m^Ei^ftiE^LTSW'^lFo^E 
tmi¥ Ltz&^Mftco =" ^x fctt^iti^ i 9 

[0070] rw^u xnmBn^zMi. i&mm 

*m^ft$iJ^^ft<-r-«b^-c#5„ ^tuci^ *H 
M2fi<£>x-?iiff v-*xA£ffl^;}xfi\ ffbv^^x 

^^©<^ • Em • e&->*x a t Lx<D&m&-*imk 

ft5<, 

[0 0 7 1] 0Sffl#j2) v;l-f3 5 ^ = 7 a 

v*>*xAco±fr«i#^£^11lT*&5o ftfc\ 0 5}' 

f+tt^aS»^HIP]«©fllrici6sa*^SEl-5 - h LX 
[0 0 7 2] HSlC^-f-i^iC^ 7;l/f7^7*lriSt 
10-,, 1 0- 2 &{t£T^5 0 — '<1 0-, 

tytt-^i-. tttB-y— ^^2-i 4r{§^, ftfe*-<©-T- 
/<1 0-2 liv-tUtt-^l-! tldBf— ^<2-2 &fit;i 
TV^5o ^LT, -^©t-^10-. [r^i£75=-yr^ 

frmmzftx^Zo #-y— /<i 0-1 , 1 o- 2 

^7^7yh4-, , 4-2 tfZtlZ'iV&WiZtlX^^o 
[0 0 7 3] lOi^ttiLtv/Vfy-f^^^fA 

n^x^^y (»)Bx-^*5itj«->xy x 1 ?-*) assft 

£tl5o fdl^£DT-^<l 0-2 ttt, I2©ay7 

^yfft** 7 -Y T ^ h 3 -2 S 2<D74zftk 

S«3yr^7 («iBx— ^fei^tDif- ^ 

[0074] tt-^io-i, 1 o- 2 14, #^ y^ry 

h4-i , 4-2 ^^<75S*{CJ^CT, 
fc^xy^x-^l^oT^y-fT^}-^-! , 4-2 (C 
3^x^^*Eff1-5o rHUit), Mi(if l©^7 
^7^h4-. t?f4, t-/no-i , 10-2 ©B^Tj^M 
ft -5 -fm&vmt £gtt-C^-T5 r t *s-et 5 0 
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#6„ 0419, 1 O-i , 1 O-2 TPBf(CtTt>n 

ts. 

[0075] (ifrIW3) v^3; a ^-i/ 3 y>' 
y*>*7'A0£fl#jftfl&j*i~B'?*>S. ft&\ 

[0 0 7 6] 06 ic^i-j; 5 l£> fejfitofcfero^/V'f- 
?7^7yh3-, , 3-z 2rf— ^1 oizmmtzt bh 

^7^7>-h3-2 ttitlHJftt^5ifiS-ffl£#ft 20 

[0 0 7 7] ttis ^XWyATVY 4-, ii^xtfH 
Hfti'tfSffifflU !2©^7-i'7yh4-2 f±0fl*tf£A 

4-2 icfcvT, if— /«i o\c&m&titz.=i 

yryy^^ryyM?7^7yF3-i, 3^ (1 

[0078] ffl£fj3hR$^&tt 1 5 irSiii 

w, £Aft ¥ftwm*&z-xifcm^ s * t-#*o 

[0 0 7 9] UfrJBflM) a-fttlnyfy^M 

0 7f±, *«t»«*:«ffl Lfca- ^ ^HSPS^X^ 40 
^^xAro^ft:«^Sr*i-|gT**)5„ ft*5. El 7 

[0 0 8 0] Emc^-f-J; 5ti, 3— nf #JpSJt|H 3 y 
7^T>h3t«m<75^7^T>h4-, , 4^ btmffi 
^-f— /<lfi, -77?-yt!)tDB6-, ta- ifW 50 
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ytDB 6-2 i:SrH5L-CV^„ 

[0 0 8 1] v^^->tUtDB6-, tfi, ^y^y 
tDB6-, iI^®^tL7t3>'7 L >-^^^.^7^7'vh4 

-, , 4-2 cDS*t'j^cTiam$ix5„ 

[0 0 8 2] f^7>f7yh4, , 4- 2 Eft Ztl 

7 l 3(c^$*rc^-ts/ MlfMlStnyfyy 

%Lx£?$i]fa<D®Mmmm&y ^-c^ftwc 

[0 0 8 3] rft^giTT^y-r^yfl^^Ty h 
3ftij-e«, ^7- y*^-* -fci- .to, 

(7) fe o fcip B p \z m Lxm tz Kzenxfa <Dmnm l &\nn% 
ss-rs„ ^mmwmxn, tif-^tytytr- 

? b £S'J* i-ftJ^-f 5 J: 5 I- 

Mhmm^no :tm5. ^©±51-3.— y©5?M 
i^cTfi^Lfc^T-y *f*-*r±, eilitfa-if i d 

i^t[^^-Hf->7-y ^-DB 6-2 t^S»$n5 0 
[0 0 8 4] 3i— ifv-^y *DB 6-2 tSS§4xfc->-t 
V^f—flX ^WW-y ^-X-^tC^lS-t- '5a-f I 

Di;J;oT#S^ti5^7^7y M-> , 4- 2 lc#LT 

*nmm-z>z\bi>nf&btzz>, 
[0 0 8 5] ftfc\ rrT-tev^y*-r-*©^ico 

7*-*£##l'fi*LT£»Li3:i-;Li:fc-C$5. ^© 

yt!)tDB6-, , 6-2 bmm^, -?*?-mm 

DBt a.— if idHD B t ^rgij^ (r^E-T 5 ^ b iW£ L- 
[0 0 8 6] £JLhf£L<ift9lL7cJ:5£, 

t ztiFfflmz.mmz j £xm*-t- z =. t &x*z ztzii 

flS-f 5 - 1 1' i oTfdKD 3V7^ «rS*1" 5 ft t\ 
[0 0 8 7] *Htte^*-Cfi, 9*7*^ 
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[0088] 4^, *HiKKi»-ett, iif-^tv't 

y :*x— ^tfcS'J^fcfliEU v"ty ^x-^Sriffl© 

ff^f vlvtivvj MzmM-fzztisxzzox^ fe 

ft&^xurttBfcSELfctK 2? SrffiK 10 

[0 0 8 9] 47i, /<J:*5>f7>'l*£0>IB0>*fll 
i4, -f ^*9^y-f^a*l*JC"CtS«>T?» 

> r y y wfg* Sr B#f^-<- * -et? x 5 3i x w * CI 

[0090] ^x^nnnm 

tf0 2*©3ttaMlftt-tV3i$ef) 14, »M©i$IKI«fc 

«19#H8) (-4 US^fC^*,, LA»L, ffit©ff2fil 

®X*7i?*? h<D]&zmm.1r?>ZiibtS:Zo 
[0 0 9 1] ±EHJf0B1ISt?B:, feSloot^ 

j^5^fc5 0 Hrzf*S*9 h©{igl4»Ii-Cfc 

[0 0 9 2] rtUcftLT, 09x.«£ffi*^5*4fT?ffl 40 
v^£>;h/T^5B{feSK©8W£JS:fflL-C, ftiU^©^ 

[0 0 9 3] 08(4, r<7?*-^<D3^7 1 ^yf^fi£^7-1' 

aaKfcv-c, »Hx*-*ibii*is5 ihu ytytr- 

Irf'Ss.* Mt£S55 2IJ, ibHx-*fEHSlS5 llnfB 50 
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K^ttfcttBx— *f©ffit©7W— A ($|xJ4\ {£« 

[0 0 94] Bf£S81&gE 5 3 (4, MHx'-^SElSfflJ 5 1 
§15 5 2T'Sl l 9abfc7 1/-A5 5W©fl©7V-A5 

3 0 '©£#, hmM®5 2X-mi££htt 

[0 0 9 5] r©±5f"UTd-7*^i^ hJtS^5 2^ 

s^fc#7w-A 5 6^7*^1^ vnm%y Is— 

#7 i — A©^W4fiBi5i/f!) ;t-x-*©B#raif$B 
x y *x*-^Elftgp 5 4 tctai)i^tifc->x y *x-* 

[0 0 9 6] - (D i. o (c-f-tui, HM<Dyu—M.X'iiM 

jgttif«ttv'XxA^g»,a<)^4^LT<tv5©-C% •> 

x y ^-x-^ ©f^^*© £±m\'m&i- z 
[0097] ttz, ->t!)t7-^oWta, fibPi 

*K^-t-5J;5^LTtAv\ r©*-a-f4, ->tytt 

1 |i:aflki-5x-^4Sr^* < i"5 ^ £ 5. 
[0 0 9 8] 4fc, ttSi-C^Kii-S^-T*^*^ 

f£«£±tf5i:x-**#Jt;tT, ttW^-^W^©^ 

xy ^-x-^-e f tf^i-5te^x-^*^#< ^oTiifs 

hicogff^^it/^co^^ h^l»ii>W7'7i^ 
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[0 0 9 9] &.±(D'Mm%mX'll, y—'<frb9 

7 t > h i;»if- ? t w- y * t &bu* (cia 
^i-sflifcovvtiftML;/!:^ h 9 i-^-TJ; 5 -9— 

[oioo] l-ftfr^, B9©{flftt, f— ^<i oflijic 
•7^yu^7®6 l -HB*., " r-CHiMx-^i^T- 10 

yh4-i , 4-2 ftiJtD*ffl7°^-ir8' Ttt, -vjvf-fxs 

[oioi] fc*3, r. r-ewg i f-*H-£«^i: lt 
•cfcpfist, f— ^i o mxwmf-^ t v-t- y -tf— 

[0102] § El l o i-^-fJ; 3 fc, iffix- 

^7^7y h 3Ki6^xm® : T— 9 hi/-ry 

tt, 'Pt£< thWiM^-o^xit, i> ? 4 T~y Y A-i , 4 

- 2 £Ed-f T/W'-f Aa^a- 2lCto 

[0 10 3] H"t?f ^ixya- Kl±> $Jx.fiMPEG 

cdpT'^u- h«t6Srfflv^T3i^ = - K£f?5 r. tick 
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* NOTICES * 
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CLAIMS 



[Claim(s)] 

[Claim 1]A data communication system made as [ distribute / data which a server and a client 

are constituted via a network so that connection is possible, and contains an animation in the 

above-mentioned client from the above-mentioned server ], comprising: 

An animation memory measure the above-mentioned server remembers a video data to be. 

A scenario memory measure which memorizes scenario information which gives a predetermined 

attribute to the above-mentioned video data. 

A reproduction means which reproduces the above-mentioned video data which is provided with 
a data sending means which transmits the above-mentioned video data and the above- 
mentioned scenario information to the above-mentioned client according to a demand from the 
above-mentioned client, and in which the above-mentioned client is sent from the above- 
mentioned server, and the above-mentioned scenario information according to the above- 
mentioned predetermined attribute. 

[Claim 2]The data communication system according to claim 1, wherein the above-mentioned 
reproduction means carries out the multiplexer of the above-mentioned video data sent from the 
above-mentioned server, and the above-mentioned scenario information and is reproduced. 
[Claim 3]The data communication system according to claim 1, wherein the above-mentioned 
data sending means carries out the multiplexer of the above-mentioned video data and the 
above-mentioned scenario information and transmits. 

[Claim ^Synchronization attribute information of a time direction for the above-mentioned 
scenario information to synchronize in time, and reproduce the above-mentioned video data and 
other contents, A data communication system given in any 1 paragraph of claims 1-3 including 
synchronization attribute information of the direction of space for synchronizing spatially and 
reproducing the above-mentioned video data, and contents besides the above. 
[Claim 5]The data communication system comprising according to claim 4: 
A hour entry showing decision time of operation in the above-mentioned video data in which 
synchronization attribute information of the above-mentioned time direction is reproduced. 
Information on an action code which should be executed to timing shown by the above- 
mentioned hour entry. 

[Claim 6]The data communication system comprising according to claim 4 or 5: 

A hour entry showing decision time of operation in the above-mentioned video data in which 

synchronization attribute information of the above-mentioned space direction is reproduced. 

Position information showing arbitrary positions in a frame shown by the above-mentioned hour 

entry. 

Information on an action code which should be executed according to operator guidance to a 
position shown by the above-mentioned position information. 

[Claim 7] A data communication system given in any 1 paragraph of claims 1-6, wherein the 
above-mentioned server has the function to edit the above-mentioned scenario information 
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according to a demand sent from the above-mentioned client. 

[Claim 8]A data communication system given in any 1 paragraph of claims 4-7 preparing 
synchronization attribute information of the above-mentioned space direction for each [ which 
constitutes the above-mentioned video data ] frame of every. 
[Claim 9]The data communication system comprising according to claim 8: 
An object setting means which specifies arbitrary objects within a certain frame in the above- 
mentioned video data. 

An image recognition means which specifies the above-mentioned object in a frame of others in 
the above-mentioned video data according to image recognition. 

A scenario generation means to generate synchronization attribute information of the above- 
mentioned space direction for every above-mentioned frame using an object in a frame which 
was specified by the above-mentioned object setting means and as for which the account of the 
upper exists, and an object in a frame besides the above specified by a described image 
recognition means. 

[Claim 10]The data communication system according to claim 9 the above-mentioned object 
setting means and a described image recognition means generating synchronization attribute 
information of the above-mentioned space direction for every above-mentioned frame when 
generating the above-mentioned scenario information, and registering with the above-mentioned 
server. 

[Claim 1 ^Synchronization attribute information of the above-mentioned space direction 
generated by specifying arbitrary objects within a frame as for which the account of the upper 
exists by the above-mentioned object setting means when generating the above-mentioned 
scenario information is registered into the above-mentioned server, The data communication 
system according to claim 8 a described image recognition means' performing described image 
recognition, and generating synchronization attribute information of the above-mentioned space 
direction for every above-mentioned frame when distributing the above-mentioned scenario 
information to the above-mentioned client from the above-mentioned server with the above- 
mentioned video data. 

[Claim 12]A data communication system comprising: 

Via a network, a server and a client are constituted so that connection is possible, Are the data 
communication system made as [ distribute / data which contains an animation in the above- 
mentioned client from the above-mentioned server ], and the above-mentioned server, A data 
sending means which transmits contents data which contains other contents which should be 
reproduced to a video data and the video data concerned synchronizing with a time direction and 
the direction of space according to a demand from the above-mentioned client to the above- 
mentioned client. 

A reproduction means which synchronizes spatially and reproduces the above-mentioned video 
data, and contents besides the above while the above-mentioned client synchronizes in time and 
reproduces the above-mentioned video data, and contents besides the above. 

[Claim 13]The above-mentioned data sending means transmits synchronization attribute 
information which gives a predetermined attribute in a time direction and the direction of space 
to the above-mentioned video data to the above-mentioned client with the above-mentioned 
video data according to a demand from the above-mentioned client. While the above-mentioned 
reproduction means synchronizes in time and reproduces the above-mentioned video data, and 
contents besides the above according to synchronization attribute information of the above 
mentioned time direction, The data communication system according to claim 12 synchronizing 
spatially and reproducing the above-mentioned video data, and contents besides the above 
according to synchronization attribute information of the above-mentioned space direction. 
[Claim 14]The data communication system comprising according to claim 13: 
A hour entry showing decision time of operation in the above-mentioned video data in which 
synchronization attribute information of the above-mentioned time direction is reproduced. 
Information on an action code which should be executed to timing shown by the above- 
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mentioned hour entry. 

[Claim 15]The data communication system comprising according to claim 13 or 14: 

A hour entry showing decision time of operation in the above-mentioned video data in which 

synchronization attribute information of the above-mentioned space direction is reproduced. 

Position information showing arbitrary positions in a frame shown by the above-mentioned hour 

entry. 

Information on an action code which should be executed according to operator guidance to a 
position shown by the above-mentioned position information. 

[Claim 16]Synchronization attribute information of the above-mentioned time direction, and 
synchronization attribute information of the above-mentioned space direction, It is constituted 
by scenario information prepared apart from the above-mentioned video data, and the above- 
mentioned reproduction means, A data communication system given in any 1 paragraph of claims 
13-15 acquiring the above-mentioned video data and the above-mentioned scenario information 
from the above-mentioned server, carrying out the multiplexer of the above-mentioned video 
data and the above-mentioned scenario information, and reproducing. 

[Claim 1 7]The data communication system according to claim 1 6, wherein the above-mentioned 
server has the function to edit the above-mentioned scenario information according to a demand 
sent from the above-mentioned client. 
[Claim 18]A data communication unit comprising: 

An animation memory measure which is a data communication unit which distributes data which 
contains an animation in a client connected via a network, and memorizes a video data. 
A scenario memory measure which memorizes scenario information which gives a predetermined 
attribute to the above-mentioned video data. 

A data sending means which transmits the above-mentioned video data and the above- 
mentioned scenario information to the above-mentioned client according to a demand from the 
above-mentioned client. 

[Claim 1 ^Synchronization attribute information of a time direction for the above-mentioned 
scenario information to synchronize in time, and reproduce the above-mentioned video data and 
other contents, The data communication unit according to claim 18 including synchronization 
attribute information of the direction of space for synchronizing spatially and reproducing the 
above-mentioned video data, and contents besides the above. 

[Claim 20]The data communication unit according to claim 18 or 19, wherein it has the above- 
mentioned animation memory measure and the above-mentioned scenario memory measure in a 
different server apparatus, respectively and has the above-mentioned data sending means in a 
server apparatus according to above, respectively. 

[Claim 21]It is a data communication unit which distributes data which contains an animation in a 
client connected via a network, A data communication unit having a data sending means which 
transmits scenario information which gives a predetermined synchronous attribute in a time 
direction and the direction of space to a video data to the above-mentioned client with the 
above-mentioned video data according to a demand from the above-mentioned client. 
[Claim 22]A data communication unit given in any 1 paragraph of claims 18-21 having the 
function to edit the above-mentioned scenario information according to a demand sent from the 
above-mentioned client. 

[Claim 23]It is a data communication unit which receives distribution of data containing an 
animation from a server connected via a network, While synchronizing in time and reproducing a 
video data sent from the above-mentioned server, and other contents according to 
synchronization attribute information of a time direction in scenario information sent from the 
above-mentioned server, A data communication unit having a reproduction means which 
synchronizes spatially and reproduces the above-mentioned video data, and contents besides 
the above according to synchronization attribute information of the direction of space in 
scenario information sent from the above-mentioned server. 
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[Claim 24]A data communication unit given in any 1 paragraph of claims 19-23 characterized by 
comprising the following. _ 

A hour entry showing decision time of operation in the above-mentioned video data in which 
synchronization attribute information of the above-mentioned time direction is reproduced. 
Information on an action code which should be executed to timing shown by the above- 
mentioned hour entry- 

[Claim 25]A data communication unit given in any 1 paragraph of claims 19-23 characterized by 
comprising the following. 

A hour entry showing decision time of operation in the above-mentioned video data in which 
synchronization attribute information of the above-mentioned space direction is reproduced. 
Position information showing arbitrary positions in a frame shown by the above-mentioned hour 

entry- , -j * 

Information on an action code which should be executed according to operator guidance to a 

position shown by the above-mentioned position information. 

[Claim 26]In a system by which a server and a client were constituted via a network so that 
connection was possible, From the above-mentioned server, are data which contains an 
animation in the above-mentioned client a data communication method to distribute, and A video 
data Scenario information which gives a predetermined attribute to the above-mentioned video 
data is independently prepared on the above-mentioned server, A data communication method 
transmitting the above-mentioned video data and the above-mentioned scenario information to 
the above-mentioned client from the above-mentioned server, and reproducing the above 
mentioned video data and the above-mentioned scenario information according to the above 
mentioned predetermined attribute in the above-mentioned client. 

[Claim 27]Synchronization attribute information of a time direction for the above-mentioned 
scenario information to synchronize in time, and reproduce the above-mentioned video data and 
other contents, The data communication method according to claim 26 including synchronization 
attribute information of the direction of space for synchronizing spatially and reproducing the 
above-mentioned video data and other contents. 

[Claim 28]The data communication method comprising according to claim 27: 
A hour entry showing decision time of operation in the above-mentioned video data in which 
synchronization attribute information of the above-mentioned time direction is reproduced. 
Information on an action code which should be executed to timing shown by the above 
mentioned hour entry. 

[Claim 29]The data communication method comprising according to claim 27 or 28: 
A hour entry showing decision time of operation in the above-mentioned video data in which 
synchronization attribute information of the above-mentioned space direction is reproduced. 
Position information showing arbitrary positions in a frame shown by the above-mentioned hour 

entry. „ . 

Information on an action code which should be executed according to operator guidance to a 

position shown by the above-mentioned position information. 

[Claim 30] A data communication method given in any 1 paragraph of claims 27-29 generating 
synchronization attribute information of the above-mentioned space direction for each L which 
constitutes the above-mentioned video data ] frame of every. 

[Claim 31]The data communication method according to claim 30 generating synchronization 
attribute information of the above-mentioned space direction for every above-mentioned frame 
by specifying the above-mentioned object which specifies arbitrary objects within a frame with 
the above-mentioned video data, and is in other frames according to image recognition. 
[Claim 32]The data communication method according to claim 31 performing described image 
recognition, generating synchronization attribute information of the above-mentioned space 
direction for every above-mentioned frame when generating the above-mentioned scenario 
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information, and registering with the above-mentioned server. 

[Claim 33]Synchronization attribute information of the above-mentioned space direction 
generated by specifying arbitrary objects within a frame as for which the account of the upper 
exists is registered into the above-mentioned server, The data communication method according 
to claim 31 performing described image recognition and generating synchronization attribute 
information of the above-mentioned space direction for every above-mentioned frame when 
distributing the above-mentioned scenario information to the above-mentioned client from the 
above-mentioned server with the above-mentioned video data. 

[Claim 34]In a system by which a server and a client were constituted via a network so that 
connection was possible, In [ are a data communication method which distributes data which 
contains an animation in the above-mentioned client from the above-mentioned server, and ] the 
above-mentioned client, While synchronizing in time and reproducing a video data sent from the 
above-mentioned server, and other contents according to synchronization attribute information 
of a time direction spent from the above-mentioned server, A data communication method 
synchronizing spatially and reproducing the above-mentioned video data sent from the above- 
mentioned server, and contents besides the above according to synchronization attribute 
information of the direction of space sent from the above-mentioned server. 
[Claim 35]The data communication method comprising according to claim 34: 
A hour entry showing decision time of operation in the above-mentioned video data in which 
synchronization attribute information of the above-mentioned time direction is reproduced. 
Information on an action code which should be executed to timing shown by the above- 
mentioned hour entry. 

[Claim 36]The data communication method comprising according to claim 34 or 35: 

A hour entry showing decision time of operation in the above-mentioned video data in which 

synchronization attribute information of the above-mentioned space direction is reproduced. 

Position information showing arbitrary positions in a frame shown by the above-mentioned hour 

entry. 

Information on an action code which should be executed according to operator guidance to a 
position shown by the above-mentioned position information. 

[Claim 37]Synchronization attribute information of the above-mentioned time direction, and 
synchronization attribute information of the above-mentioned space direction, It is constituted 
by scenario information prepared apart from the above-mentioned video data, and the above- 
mentioned video data and the above-mentioned scenario information are transmitted to the 
above-mentioned client from the above-mentioned server according to a demand from the 
above-mentioned client, A data communication method given in any 1 paragraph of claims 34-36 
carrying out the multiplexer of the above-mentioned video data and the above-mentioned 
scenario information, and reproducing in the above-mentioned client. 

[Claim 38]A recording medium recording a program for operating a computer as each means of a 
statement on any 1 paragraph of claims 1-25 and in which computer reading is possible. 
[Claim 39]A recording medium recording a program for making a computer perform procedure of 
a data communication method of a statement on any 1 paragraph of claims 26-37 and in which 
computer reading is possible. 
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DETAILED DESCRIPTION 



[Detailed Description of the Invention] 
[0001] 

[Field of the Invention]This invention is used for the data communication system which 
distributes a video data on networks, such as the Internet, especially about the recording 
medium which recorded the program for software to realize a data communication system and a 
device, data communication methods, and also these functions, and is preferred. Also in the 
cable TV which has Internet services, this invention is a suitable system. 
[0002] 

[Description of the Prior Art]Now, the structure which distributes an animation (image) to a 
client from a server via networks, such as the Internet, is provided. However, in mainstream 
ISDN (Integrated Services Digital Network), it will take now the time when transmission speed is 
immense for distributing 64K bps and the animation which is late and has very much data 
volume. Therefore, the actual condition is that so many animation distribution is not used. 
[0003]On the other hand, in recent years, the telecom infrastructure of the next generation 
which realizes tens times as high speed communication as ISDN has been fixed. If the 
infrastructure of high speed communication is fixed, high quality and a high definition video data 
will be distributed to the inside of a short time, and it will become possible to obtain a smooth 
reproduced image by a client side. Therefore, it is expected that the frequency where various 
contents, such as music and an animation, communicate on a network will become high from now 
on. 

[0004]Only the gestalt with which most animation distribution performed now only transmits a 
video data to a client side in one-way traffic from the server side is taken. However, to realize 
the structure of providing additional information from now on synchronizing with the animation 
currently reproduced is desired.For example, if the additional information which introduces in 
detail the goods displayed into an animation can be displayed taking the animation under 
reproduction, and a synchronization, it will become possible to provide the new form of electronic 
commerce technology or advertising on Internet. 
[0005] 

[Problem(s) to be Solved by the Invention]As a method of synchronizing an animation and other 
contents on the Internet, Languages, such as SMIL (Synchronized Multimedia Integration 
Language) and HMML (Hyper Media Markup Language), are known. These days, a language called 
ICML (Intermedia Casting Markup Language) is also announced. Each of such languages is 
languages which have a function which the animation currently reproduced on a browser and 
other contents on a browser are synchronized, and is displayed. 

[0006] However, although the time synchronization with an animation and other contents could be 
taken in such languages, it was difficult to realize communication [ that it is interactive and both 
directions ]. Although it had in ICML a function for which a user is made to choose a desired 
thing out of two or more subcontents during reproduction of an animation, it was difficult to 
realize complicated interactive communications other than this. 

[0007]That is, there was almost no flexibility of fast forwarding [ reproduce freely by the ability 
of the time synchronization with an animation and other contents to only be taken, stop, suspend 
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it and ] and rolling back an animation in each above-mentioned language. It was difficult for a 
user to give directions during reproduction of an animation and to realize interactive operation of 
interrupting below it and performing desired operation. 

[0008]In each above-mentioned language, even when a time synchronization was taken, when 
creating in time long contents and the contents with which an animation and other contents 
synchronize to delicate timing, time and effort was taken dramatically, and there was a problem 
that this may be unrealizable. t 
[0009]Animation display contents with interactive nature, such as Shockwave and real media, 
also exist. However, in Shockwave, there is a problem that data other than an an.mat.on w.l 
become huge, and there is a problem that the flexibility of expression of a time d.rect.on is low, 
by real media. Since the synchronous display with an animation was realized from the contents 
which encode an animation and other contents and were made, there was also a problem that 
the contents of contents could not be changed interactively and actively. 
[0010]following on development of a telecom infrastructure from now on — animation 
distribution — frequency — if used [ come ] mostly, it will be required increasingly that .t not 
only makes it display, but it should only synchronize an animation and other contents in time, and 
should realize real time and interactive communication. However, the means for realizing this 
demand until now was not provided at all. 

[0011]This invention is accomplished in view of such the actual condition, more than on wh.ch an 
animation and other contents are synchronized in time and displayed is complicated, and an 
object of this invention is to enable it to realize real time and interactive communication eas.ly. 

[0012] r . 

[Means for Solving the Problem]As for a data communication system of this invention, via a 
network, a server and a client are constituted so that connection is possible, Are the data 
communication system made as [ distribute / data which contains an animation in the above- 
mentioned client from the above-mentioned server ]. and the above-mentioned server, An 
animation memory measure which memorizes a video data, and a scenario memory measure 
which memorizes scenario information which gives a predetermined attribute to the above 
mentioned video data, Have a data sending means which transmits the above-mentioned video 
data and the above-mentioned scenario information to the above-mentioned client according to 
a demand from the above-mentioned client, and the above-mentioned client, It had a 
reproduction means which reproduces the above-mentioned video data sent from the above 
mentioned server, and the above-mentioned scenario information according to the above 
mentioned predetermined attribute. 

[0013]Via a network, a server and a client comprise other modes of this invention so that 
connection is possible, Are the data communication system made as [ distribute / data which 
contains an animation in the above-mentioned client from the above-mentioned server J, and the 
above-mentioned server, According to a demand from the above-mentioned client, it has a data 
sending means which transmits contents data containing other contents wh.ch should be 
reproduced to a video data and the video data concerned synchronizing with a time d.rect.on and 
the direction of space to the above-mentioned client, The above-mentioned client was provided 
with a reproduction means which synchronizes spatially and reproduces the above-mentioned 
video data, and contents besides the above while it synchronized in time and reproduced the 
above-mentioned video data, and contents besides the above. 

[0014]An animation memory measure which a data communication unit of this invention is a data 
communication unit which distributes data which contains an animation in a client connected v.a 
a network, and memorizes a video data, It had a scenario memory measure which memorizes 
scenario information which gives a predetermined attribute to the above-mentioned video data, 
and a data sending means which transmits the above-mentioned video data and the above 
mentioned scenario information to the above-mentioned client according to a demand from the 
above-mentioned client. 

[0015]It is a data communication unit which distributes data which contains an animation in a 
client connected via a network in other modes of this invention, According to a demand from the 
above-mentioned client, it had a data sending means which transmits scenario informat.on wh.ch 



JP,2002-176638,A [DETAILED DESCRIPTION] 



3/14 *} 



gives a predetermined synchronous attribute in a time direction and the direction of space to a 
video data to the above-mentioned client with the above-mentioned video data. 
[0016]It is a data communication unit which receives distribution of data containing an animation 
in a mode of others of this invention from a server connected via a network, While synchronizing 
in time and reproducing a video data sent from the above-mentioned server, and other contents 
according to synchronization attribute information of a time direction in scenario information 
sent from the above-mentioned server, According to synchronization attribute information of the 
direction of space in scenario information sent from the above-mentioned server, it had a 
reproduction means which synchronizes spatially and reproduces the above-mentioned video 
data, and contents besides the above. 

[0017]In a system by which as for a data communication method of this invention a server and a 
client were constituted via a network so that connection was possible, From the above- 
mentioned server, are data which contains an animation in the above-mentioned client a data 
communication method to distribute, and A video data, Scenario information which gives a 
predetermined attribute to the above-mentioned video data is independently prepared on the 
above-mentioned server, The above-mentioned video data and the above-mentioned scenario 
information are transmitted to the above-mentioned client from the above-mentioned server, 
and the above-mentioned video data and the above-mentioned scenario information were 
reproduced according to the above-mentioned predetermined attribute in the above-mentioned 
client. 

[0018]In a system by which a server and a client comprised other modes of this invention via a 
network so that connection was possible, In [ are a data communication method which 
distributes data which contains an animation in the above-mentioned client from the above- 
mentioned server, and ] the above-mentioned client, While synchronizing in time and reproducing 
a video data sent from the above-mentioned server, and other contents according to 
synchronization attribute information of a time direction spent from the above-mentioned server, 
According to synchronization attribute information of the direction of space sent from the 
above-mentioned server, it synchronizes spatially and the above-mentioned video data sent 
from the above-mentioned server, and contents besides the above were reproduced. 
[001 9]A program for a recording medium which can computer read this invention to operate a 
computer as any 1 paragraph of claims 1-23 as each means of a statement, Or a program for 
making a computer perform procedure of a data communication method of a statement was 
recorded on any 1 paragraph of claims 24-35. 

[0020]Since this invention comprises the above-mentioned arts means, according to 
synchronization attribute information of a time direction, In addition to reproducing other 
contents, according to synchronization attribute information of the direction of space, it also 
becomes possible to reproduce other contents corresponding to operation of directing a spatial 
specific position set up in a video data etc., taking a synchronization in time with a video data. 
[0021]Since according to other features of this invention it is prepared independently and it 
distributes independently, and a video data and scenario information including the above- 
mentioned synchronization attribute information carry out a multiplexer and are reproduced by a 
client side of a distribution destination, It becomes possible to change the contents of contents 
only by rewriting scenario information, and it becomes possible not to ask whether it is under 
[ animation distribution ] ******, but to perform real time contents edit easily. 
[0022] 

[Embodiment of the Invention]Hereafter, one embodiment of this invention is described based on 
a drawing. Drawing 1 is a figure showing roughly the example of composition of the whole data 
communication system by this embodiment. 

[0023]As shown in drawing 1 , the data communication system of this embodiment is provided 
with the scenario server 1, the animation server 2, the contents creation client 3, the 1st and 
2nd client (personal computer etc.) 4 _ 1? and 4 _ 2 . It is connected by networks, such as the 

Internet, and these server and clients 1-4 can transmit now and receive data mutually. 
[0024]The animation server 2 is provided with animation DB(database)7, and distributes various 
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kinds of animations saved this animation DB7 according to the demand from each client 4 and 
4 _ . It is generated by the contents creation client 3, this is transmitted to the animation server 
2 via a network, and this video data is saved animation DB7. The encoding of the animation itself 
can respond also to the form of MPEG (moving picture coding experts group), AVI (audio video 
interleaved), MOV, WMV, and other throats. . 
[0025]The scenario server 1 is provided with scenario DB6 which saves the data (this is called 
scenario information in this embodiment) which gives a predetermined attribute to an animation. 
One or more scenario information saved this scenario DB6 is distributed to client 4 _ 1 and 4 _ 2 
with the video data which is equivalent to one or more video datas saved animation DB7, 
respectively, and corresponds. It is generated by the contents creation client 3, this is 
transmitted to the scenario server 1 via a network, and this scenario information .s also saved 

scenario DB6. f 
[0026]The above-mentioned scenario information includes the attribution information tor 
synchronizing spatially and reproducing the attribution information for synchronizing in time and 
reproducing an animation and other contents, and an animation and other contents. The 
synchronization attribute information over the former time direction is constituted including the 
hour entry (time code) showing the decision time of operation in the animation reproduced, and 
the information on the action code which should be executed to each timing shown by this hour 

[0027]The synchronization attribute information over the latter direction of space, The hour 
entry (time code) showing the decision time of operation in the animation reproduced, It is 
constituted including the position information showing the arbitrary space positions in an 
animation, the size information showing the size of the rectangular area in the position shown by 
the position information, and the information on the action code which should be executed 
according to the operator guidance from the user to the rectangular area. 

[0028]The frame information for, for example, specifying arbitrary frames among the frames ot a 
large number which constitute an animation can constitute the above-mentioned hour entry. The 
coordinate information showing the arbitrary positions in the frame specified by frame 
information can constitute position information. The text data which should be fundamentally 
displayed as other contents, URL (Uniform Resource Locator), the program wh.ch should be 
executed, etc. can constitute the contents which should be performed by an action code_ 
[0029]In this embodiment, since the definition of operation to this action code itself can be 
edited, almost all the functions that can be performed by each client 4 ^ and 4 _ 2 can be 
performed synchronizing with moving image reproduction. That is, it can be said that the data 
communication system of this embodiment is provided with the byte code engine wh.ch operates 

by a frame base. . , 

[0030]The contents creation client 3 and each client 4 _ v and 4 _ 2 are provided with the 

exclusive player 8 provided in this embodiment. The exclusive player 8 has a function which 
carries out the multiplexer of the scenario information distributed from the scenario server 1, 
and the video data distributed from the animation server 2, and is reproduced. It also has the 
function to perform reproduction of an animation, stop, halt, rapid traverse, and rew.nd.ng. It also 
has edit / creation function of a video data or scenario information. 

[0031]Next, operation of the data communication system constituted as mentioned above is 
explained. First, in the contents creation client 3, the video data which should be distributed to 
each client 4 _ 1 and 4 _ 2 , and the scenario information corresponding to it are created 
independently^ And those data is registered into the animation server 2 and the scenario server 
1 via a network, respectively. It is possible to use the exclusive player 8 or the exclusive editing 
system which is not illustrated in the case of creation of this video data and scenario 

information. , , . . , 

[0032]The video data registered into the animation server 2 and the scenario server 1 and the 
scenario information corresponding to it are distributed to each client 4 H and 4 _ 2 according to 
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the distribution request from the exclusive player 8 with which each client 4 _ 1 and 4 _ 2 were 

equipped. And in the exclusive player 8, the multiplexer of the video data sent from the animation 
server 2 and the scenario information sent from the scenario server 1 is carried out, and it is 
reproduced. 

[0033]While reproducing the animation in which the exclusive player 8 was distributed at this 
time, according to the synchronization attribute information over the time direction of the 
distributed scenario information, other contents are reproduced or displayed on an animation and 
another window, taking the animation under reproduction, and a time synchronization. For 
example, it is possible to display the detailed information of the goods displayed into an 
animation on another window synchronizing with an animation etc. Of course, other contents 
which are synchronized with the animation under reproduction and displayed may be arbitrary 
information which is irrelevant not only to the information relevant to an animation but an 
animation. 

[0034]When the exclusive player 8 detects what the position pinpointed during reproduction of 
an animation according to the synchronization attribute information over the direction of space 
of scenario information was directed for by the user's mouse click etc., The action code related 
with the position is followed, and other contents are reproduced or displayed on an animation 
and another window. For example, when the position of the goods displayed to a certain timing in 
an animation is pinpointed by the synchronization attribute information over the direction of 
space of scenario information and the mouse click of the place is carried out, it is possible to 
display the detailed information of the product on another window etc. 

[0035]Draw ing 2 is a figure showing the example of the display screen of client 4 ^ and 4 _ 2 . In 

the example shown in drawing 2 , the viewing window 11 of an interactive player, the browser 
window 12 of a text, the browser window 13, and the other windows 14 are displayed. 
[0036]Among these, the window 11 of an interactive player is provided with the following. 
The field 15 which displays the reproduced animation. 

The manual operation button 16 for directing rewinding of an animation, reproduction, a halt, a 
stop, and a rapid traverse. 

The slide bar 17 for directing the time playback position of an animation. 

Reproduction of an animation will move the bar 18 of the slide bar 17 to the right end gradually 
according to the regeneration time of an animation from the left end. By moving this bar 18 
compulsorily by the drag operation of a mouse, an animation is renewable from arbitrary times. 
[0037]The state where one frame was displayed to a certain timing in an animation is shown to 
the animation display field 15 by the example of drawing 2 . At this time, it is possible to display 
the text sentence which expresses the contents of that frame image with the browser window 
12 of a text, for example. This text sentence is specified by the synchronization attribute 
information over the time direction of scenario information. Other contents similarly specified by 
the synchronization attribute information over the time direction of scenario information are 
displayed on the browser window 1 3. In the example of drawing 2 , the contents showing the 
detailed information about the brand of the dress which the woman displayed into the animation 
wears are displayed. 

[0038]The contents currently displayed on the browser window 13 in the example of this drawin g 
2^are the web contents (web page of a certain URL) by HTML (Hyper Text Markup Language) 
which can be seen by the usual web browser. It is also possible to display the information on a 
link destination on the browser window 13 by specifying the hyperlink portion stretched in this 
HTML information by a mouse click. 

[0039]The arbitrary positions on the moving image frame displayed on the animation display field 
1 5 are pinpointed by the synchronization attribute information over the direction of space of 
scenario information. In the example of drawing 2 , the rectangular area 19 showing the clock 
portion which the man displayed into the animation has stuck is pinpointed by the 
synchronization attribute information of the direction of space. If the portion of this pinpointed 
rectangular area 19 is specified by mouse operation, according to the action code related with 
the position of that rectangular area 19, other contents (not shown) will be displayed on the 
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browser window 1 3 by the synchronization attribute information of the direction of space, for 
example. 

[0040]Although other contents which synchronize in the direction of space here are displayed on 
the browser window 1 3, another window is started and it may be made to display. It becomes 
possible to display both contents simultaneously, without displaying other contents which change 
to other contents in sync with a time direction, and synchronize in the direction of space on the 
browser window 1 3, if it does in this way. 

[0041 ]In the example of drawing 2 , the function button 20 for directing to display other contents 
which do not relate to the position to which the upper part in the animation displayed on the 
animation display field 1 5 was fixed in relation to the animation under reproduction is displayed. 
That is, when creating a video data by the contents creation client 3, he is trying to include the 
picture of the function button 20 in each frame of an animation. And he is trying to pinpoint the 
position of this function button 20 by the synchronization attribute information over the direction 
of space of scenario information. 

[0042]Thus, if a user specifies the displayed function button 20 by a mouse click etc. as some 
animations, According to the action code related with the position of the button, other contents 
(not shown) are displayed on the browser window 13 by the synchronization attribute information 
of the direction of space, for example, or — being concerned — others — window where the 
browser window 13 is another is started, and it may be made to display contents 
[0043]In drawing 2 , it has the Link button, the Live button, Link2 button, the Info button, and the 
Next button as the function button 20. The button for directing and the Live button that the Link 
button and Link2 button sink below other programs during reproduction of an animation, and are 
reproduced The button for directing to sink below live broadcasts during reproduction of an 
animation, and to reproduce, the button for directing that the Info button displays predetermined 
information information, and the Next button are buttons for directing to reproduce the following 
animation. The kind of button quoted here is mere illustration, and it is also possible to have 
feature buttons other than this. 

[0044]Thus, it is also possible to give the synchronization attribute information of the direction 
of space for every frame in this embodiment to a picture (for example, rectangular area 19 
surrounding objects, such as a person, a thing, a building, a vehicle, etc. which moves in an 
animation) with a motion in the animation display field 15, and, It is also possible to display the 
picture of the always operational function button 20 into an animation, and to give the 
synchronization attribute information of the direction of space during reproduction of an 
animation, at this. And it is possible to associate arbitrary action codes to the rectangular area 
19 and the function button 20 of these objects, to make scenario information, and to perform 
arbitrary operations according to a mouse click etc. 

r0045l Drawing 3 is a block diagram showing the detailed functional constitution of the scenario 
server 1 shown in drawing 1 , the animation server 2, and the exclusive player 8. The animation 
server 2 is provided with the following in drawing 3 . 
Besides animation DB7, it is the web server 31. 

For example, the interface 32 by TCP/UDP (transmission control protocol /user datagram 
protocol). 

[0046]The web server 31 performs processing which takes out the video data corresponding to 
the demand from animation DB7 according to the file acquisition request sent from the file 
reading unit 37 of the exclusive player 8. The video data taken out from animation DB7 is 
transmitted to the exclusive player 8 via the interface 32 of TCP/UDP. Although the protocol of 
UDP is used here, other protocols, such as IIS (internet information server), may be used. 
[0047]The scenario server 1 is provided with the scenario creation control section 33, DB 
access part 34, the client access control section 35, and the scenario edit control part 36 other 
than scenario DB6. The scenario creation control section 33 controls creation processing of the 
scenario information which should be saved scenario DB6 according to the creation demand of 
the scenario information supplied from the client access control section 35. 
[0048] DB access part 34 performs access for performing read-out or the writing of scenario 
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information to scenario DB6 according to the command from the scenario creation control 
section 33 and the scenario edit control part 36. 

[0049]The demand to which the client access control section 35 is sent from TCP/IP43 of the 
exclusive player 8 (the animation by operation of the manual operation button 16 shown in 
drawing 2) [ and ] Instruction requests, such as a halt, a stop, a rapid traverse, and rewinding, the 
instruction request of the moving-image-reproduction starting position by operation of the slide 
bar 17, the edit demand of scenario information, etc. are received and analyzed, and the result is 
told to the scenario creation control section 33 and the scenario edit control part 36. Thereby, 
the scenario information corresponding to the time playback position of the animation is read, 
and it controls to transmit to the exclusive player 8 or to edit scenario information. 
[0050]The scenario edit control part 36 controls the editing processing of the scenario 
information which should be saved scenario DB6 according to the edit demand of the scenario 
information supplied from the client access control section 35. Edit of this scenario information 
is possible also for carrying out, while not performing animation distribution, and can also be 
carried out to real time during execution of animation distribution. The details of this structure 
are mentioned later. 

[0051]In the composition of the exclusive player 8, the file reading unit 37 outputs the 
acquisition request of a desired dynamic image file to the web server 31 of the animation server 
2, and reads the dynamic image file sent from the interface 32 of TCP/UDP as the response. It 
is determined by the control of the motion-control part 46 which a user specifies a desired 
dynamic image file clearly, for example, or of which dynamic image file acquisition is required 
mentions later. The separation part 38 separates a video data and voice data from the dynamic 
image file read in the file reading unit 37. 

[0052]The animation decode part 39 decodes compression of the video data separated by the 
separation part 38. The voice decode part 40 decodes compression of the voice data separated 
by the separation part 38. The video data decoded by the animation decode part 39 is displayed 
on a display screen (portion equivalent to the animation display field 1 5 of dra w ing 2). The voice 
data decoded by the voice decode part 40 is outputted from the loudspeaker etc. which are not 
illustrated. 

[0053]Decoding to such video datas and voice data is performed according to control of the 
animation control section 41. The animation control section 41 performs control of the animation 
decode part 39 and the voice decode part 40 in this way. Information on mouse operation that 
the animation control section 41 was analyzed by the mouse operation analyzing parts 45 (the 
animation by operation of the manual operation button 16 shown in drawing 2 ) [ and ] According 
to instruction requests, such as a halt, a stop, a rapid traverse, and rewinding, the instruction 
request of the moving-image-reproduction starting position by operation of the slide bar 17, etc., 
processing etc. which adjust the time playback position of an animation are performed. At this 
time, the animation control section 41 manages the time playback position of an animation, and 
outputs regeneration time information to the mouse operation analyzing parts 45 and the 
motion-control part 46. 

[0054]The screen where the video data outputted from the above-mentioned animation decode 
part 39 is displayed is constituted including the animation display layer 42a and the mouse 
detecting position layer 42b. The video data decoded by the animation decode part 39 is 
displayed on the animation display layer 42a. If a mouse is clicked in the arbitrary positions on a 
display screen, the position information on the mouse operation will be detected by the mouse 
detecting position layer 42b, and will be outputted to the mouse operation analyzing parts 45. 
[0055]The interfaces 43 by TCP/IP are various demands (the animation by operation of the 
manual operation button 16 shown in drawing 2 ) to the scenario server 1. [ and ] Processing 
which outputs instruction requests, such as a halt, a stop, a rapid traverse, and rewinding, the 
instruction request of the moving-image-reproduction starting position by operation of the slide 
bar 1 7, etc. is performed. The scenario information sent from the scenario server 1 is received, 
and processing which memorizes the synchronization attribute information of a time direction 
and the synchronization attribute information of the direction of space which are included in it to 
the synchronization-attribute-information storage parts store 44 is performed. 
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[0056]The position coordinate information of the mouse operation from which the mouse 
operation analyzing parts 45 were detected by the mouse detecting position layer 42b. Based on 
the regeneration time information outputted from the animation control section 41, it is analyzed 
to which manual operation button in a display screen mouse operation was performed, or to 
which position mouse operation was performed in which timing of the animation under 
reproduction. 

[0057]The regeneration time information to which the motion-control part 46 was outputted 
from the animation control section 41, Based on the contents of the mouse operation analyzed 
by the mouse operation analyzing parts 45, and the synchronization attribute information 
memorized by the synchronization-attribute-information storage parts store 44, The operations 
(for example, change to video datas to the browser window 13 of drawing ^!, such as other 
display action and other programs of contents, and live broadcasts, etc.) shown by the action 
code contained in synchronization attribute information are controlled. 

[0058]Specifically, the motion-control part 46 is controlled to display other contents specified by 
the synchronization attribute information concerned on the browser window 13, synchronizing 
with the animation under reproduction based on the synchronization attribute information and 
the regeneration time information on a time direction. Based on the analysis content of mouse 
operation, and the synchronization attribute information of the direction of space, the motion- 
control part 46, Other contents related with the position of mouse operation by the 
synchronization attribute information concerned are displayed on the browser window 13 or 
another window, or it controls to display other video datas, such as other programs and live 
broadcasts, on the browser window 13 or animation display field 15 grade. 
[0059]As mentioned above, in the data communication system of this embodiment. The 
synchronization attribute information over the time direction for synchronizing an animation and 
other contents (other animations are included) in time, and displaying them, The scenario 
information included the synchronization attribute information over the direction of space for 
displaying other contents (other animations are included) synchronizing with the tab control 
specification to arbitrary objects, function buttons, etc. in an animation is distributed with a video 
data. And it is a reproduction side, and he carries out the multiplexer of a video data and the 
scenario information, and is trying to reproduce. 

[0060]Thereby, according to this embodiment, information can be given also not only to a time 
direction but to the direction of space to an animation. That is, by it not only displaying, but 
synchronizing an animation and other contents in time and specifying the arbitrary objects in an 
animation, etc. by a mouse click etc., other contents specified by position information, such as 
the object, can be synchronized with an animation, and can be displayed. That is, it becomes 
possible to realize the synchronization of a time direction, and the synchronization to the 
animation of the direction of space as a result which gives an attribute with a scenario and is 
distributed to the object [ being arbitrary (for example, wholly) ] which appears in the animation 
to reproduce. 

[0061]In this embodiment, since a video data is created only by it and the scenario information 
which gives an animation attribute is created apart from a video data, the synchronization with 
an animation and other contents can be easily adjusted only by editing scenario information. 
Thereby, long contents, the contents that an animation and other contents synchronize to 
delicate timing, etc. can be created easily in time. The control which fast forwards [ which fast 
forwards, and reproduces, suspends and suspends it ] it and rolls back an animation freely is also 
easily realizable, taking other contents and a synchronization. 

[0062]Only the method of encoding and distributing the animation decided beforehand and other 
contents and the method of distributing the contents which contain an animation and other 
contents by operation described in the prescribed language was able to be done conventionally. 
That is, unless it was directions for use assumed beforehand, the synchronous display of 
contents was not able to be realized. 

[0063]On the other hand, it is not made to synchronize by synchronizing an animation and other 
contents, such as HTML, with a linguistic level, or encoding an animation and other contents 
collectively in this embodiment, He is a reproduction side and is trying to synchronize an 
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animation and other contents by creating independently an animation and the scenario which 
gives the animation attribute, and distributing it. 

[0064]Thereby, according to this embodiment, even if it is during reproduction of an animation, 
other contents information added and displayed on an animation can also change a scenario (the 
contents of contents), while it is possible to create and edit at any cost by the time it actually 
distributes. That is, contents can be edited into real time. Thereby, application as shown below is 
also attained. 

[0065](Application 1) Common contents preparing system drawing 4 is a figure showing the 
example of an entire configuration of the common contents preparing system adapting this 
embodiment. In drawing 4 , the same numerals are given to the component shown in dr awing 1 , 
and the component which has the same function. The suffix character attached to the same 
numerals shows that two or more same composition exists. 

[0066]As shown in drawin g 4 , a common contents preparing system, Two or more contents 
creation client 3 _ 1? 3 _ 2 , and 3 _ 3 are connected to the scenario server 1 and the animation 

server 2 (below, these servers 1 and 2 are collectively described as the server 10) via a network, 
respectively, and it is constituted. 

[0067]In this case, creation and the animation to edit are jointly displayed on the animation 
display field 1 5 among the display screens shown in drawing 2 by two or more contents creation 
client 3 _ 1f 3 _ 2 , and 3 _ 3 - A chat screen or a video conferencing screen for the user of each 

contents creation client 3 _ v 3 _ 2 , and 3 _ 3 to perform an utterance etc. freely etc. is displayed 

on the browser window 13. This chat screen is synchronized in time and it may be made to 
display it on the animation reproduced on the animation display field 15, and it answers that the 
mouse click of the specific position in a moving image frame was carried out, and it may be made 
to display it. 

[0068]Thus, by using the real-time edit function with which the exclusive player 8 is provided, 
while two or more makers who are present in a remote place reproduce a common animation by 
each exclusive player 8, contents can be created together. For example, two or more persons 
can create the animation contents on the Internet, a TV program, a movie, etc. together. 
[0069]Conventionally, when two or more makers created contents together, the portion in its 
duty was manufactured individually, recording-medium record needed to be carried out, and it 
needed to be gathered mutually, or each maker needed to deliver it. And the work of correcting 
the contents of the portion in its duty which each maker manufactured by arrangement needed 
to be repeated, and needed to be performed. Therefore, it was not able to work efficiently by 
creating contents taking time and effort and time dramatically. 

[0070]On the other hand, according to this embodiment, two or more makers who are present in 
a remote place can create contents together in real time via a network, and can lose restrictions 
time and regarding the place. Thereby, if the data communication system of this embodiment is 
used, it will become applicable as a creation and distribution / distribution system of new 
contents. 

[0071](Application 2) Multi-communication system multi-live drawing 5 is a figure showing the 
example of an entire configuration of the multi-communication system adapting this embodiment. 
In drawin g 5, the same numerals are given to the component shown in drawin g 1 , and the 
component which has the same function. The suffix character attached to the same numerals 
shows that two or more same composition exists. 

[0072]As shown in dr awi ng 5, the multi-communication system which realizes the multi-live is 
provided with two or more server 10 _ 1 and 10 _ 2 . One server 10 _ 1 was provided with scenario 
server 1 _ 1 and animation server 2 and server 10 _ 2 of another side is provided with scenario 
server 1 _ 2 and animation server 2 _ 2 . And while 1st contents creation client 3 _ 1 is connected 
to one server 10 _ 1f 2nd contents creation client 3 _ 2 is connected to server 10 _ 2 of another 
side. Each client 4 _ 1 and 4 _ 2 are connected to each server 10 -1 and 10 _ 2 , respectively. 
[0073]In the multi-live system constituted in this way, the contents (a video data and scenario 
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information) of the 1st live broadcasts created by 1st contents creation client 3 H are 
registered into one server 10 _ r The contents (a video data and scenario information) of the 2nd 
live broadcasts created by 2nd contents creation client 3 _ 2 are registered into server 10 _ 2 of 
another side. 

[0074]Each server 10 ^ and 10 _ 2 distribute contents to each client 4 H and 4 _ 2 according to 
the scenario information beforehand decided according to the demand from each client 4 _ 1 and 
4 _ 2 - Thereby, by 1st client 4 _ v it can display, for example in response to distribution of live 
broadcasts which are different from both server 10 _ 1 and 10 _ r At this time, the live broadcasts 
which should be displayed can be changed to real time by what predetermined operation is 
performed for by the exclusive player 8 (for example, the Live button shown in drawing 2 is 
pushed). That is, exchange from the live broadcasts etc. which are simultaneously performed by 
each server 10 _ 1 and 10 _ 2 can be performed. 

[0075](Application 3) Multi-communication system marriage ceremony drawing 6 is a figure 
showing the example of an entire configuration of the multi-communication system adapting this 
embodiment. In drawing 6 , the same numerals are given to the component shown in drawing 1 , 
and the component which has the same function. The suffix character attached to the same 
numerals shows that two or more same composition exists. 

[0076] As shown in drawing 6 , two or more client 4 _ 1 and 4 _ 2 are connected to the server 10, 
and the multi-communication system for a marriage ceremony is constituted while connecting 
two or more contents creation client 3 _ 1 and 3 _ 2 to the server 10. In this case, for example, 1st 
contents creation client 3 _ 1 creates a marriage ceremony above child as contents containing an 
animation, and 2nd contents creation client 3 _ 2 creates situations, such as parents, 
grandparents, etc. who are present in a remote place, as contents containing an animation. And 
the contents created by each contents creation client 3 _ 1 and 3 _ 2 are registered into the 

server 10. 

[0077]A relative etc. use 1st client 4 _ v and a friend etc. use 2nd client 4 _ 2 . And in these client 
4 H and 4 _ 2 , it displays in response to distribution of the contents registered into the server 10. 
It is also possible to receive and display the contents registered into the server 10 on each 
contents creation client 3 _ 1 and 3 _ 2 . 

[0078]By displaying an animation, for example on the animation display field 15, and displaying a 
chat screen etc. on the browser window 13 at this time, Parents, grandparents, a relative, a 
friend, etc. who are present in a remote place can participate in a marriage ceremony freely 
exceeding distance, the scenery that the person himself/herself who gets married has held a 
ceremony overseas can be distributed at home, or it can also talk using the parents etc. and the 
animation which are at home. 

[0079](Application 4) User participation type contents preparing system drawing 7 is a figure 
showing the example of an entire configuration of the user participation type contents preparing 
system adapting this embodiment. In drawing 7 , the same numerals are given to the component 
shown in drawing 1 , and the component which has the same function. The suffix character 
attached to the same numerals shows that two or more same composition exists. 
[0080]As shown in drawing 7 , the contents creation client 3, and two or more client 4 _ 1 and 4 _ 2 
are connected to the server 10, and the user participation type common contents preparing 
system is constituted. The scenario server 1 is provided with master scenario DB6 _ 1 and user 

scenario DB6 _ 2 in this system. 

[0081 ]The original contents created by the contents creation client 3 are registered into master 
scenario DB6 __ y In an initial stage, the contents registered into this master scenario DB6 H are 
distributed according to the demand of each client 4 _ 1 and 4 _ 2 . 
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[0082]In each client 4 _ 1 and 4 _ 2 , a user looks at the distributed contents and the change 
request to contents, etc. are inputted through the chat screen etc. which were displayed on the 
browser window 1 3 of drawing 2 . For example, although he would like to know information 
detailed about the goods which come out into an animation, since the synchronization attribute 
information of the direction of space is not linked to the product, when detailed information 
cannot be seen, the request of a purport which wants to know information detailed about the 
product is inputted. 

[0083]In response by the contents creation client 3 side, the synchronization attribute 
information of the direction of space is newly set up to goods with a request by editing scenario 
information. According to this embodiment, since he is trying to create a video data and scenario 
information independently, real time contents edit to the request performed during reproduction 
of an animation can also be performed easily. Thus, the scenario information edited according to 
a users request is registered into user scenario DB6 _ 2 , f° r example with user ID. 
[0084]The scenario information registered into user scenario DB6 _ 2 is distributed only to client 
4 _ 1 and 4 _ 2 which are specified by the user ID corresponding to the scenario information. By 

doing in this way, it also becomes possible to reconstruct contents peculiar to the user other 
than the original contents distributed in common with many users according to a user's request. 
[0085]Although only edit of scenario information is explained here, when there is a request of 
wanting you to change the contents of an animation themselves from a user, a video data is 
edited easily and can be reregistered. In this case, it is preferred like scenario DB6 _ 1 and 6 _ 2 to 

prepare the master animation DB and the user animation DB independently. 
[0086]By carrying the synchronization attribute information of a time direction and the direction 
of space to the animation to reproduce according to this embodiment, as explained in detail 
above, The more complicated and interactive operation of displaying other contents etc. is 
realizable by it not only being able to displaying, but synchronizing an animation and other 
contents in time and specifying the arbitrary positions in an animation by a mouse click etc. 
[0087]In this embodiment, although there is default scenario information, scenario information 
can be changed if needed. It also has the function to edit the scenario information itself, and can 
perform easily two or more persons creating contents jointly, or creating the scenario 
information which has the added value which not only the decided scenario information but each 
user desires. 

[0088]Since a video data and scenario information can be prepared independently and scenario 
information can be edited into real time during reproduction of an animation in this embodiment, 
Besides reproducing the contents of the contents decided beforehand, the contents according 
to a user's request can be edited promptly, and can be provided, or urgent interruption can be 
given to a server, and live broadcasts and a TV phone can be poured, or a news bulletin etc. can 
also be passed arbitrarily. 

[0089]The communication between a server and a client is interactive, and since it is 
bidirectionally possible, it can also talk using a character, a sound, an animation (image), etc. by 
those which are looking at contents, such as a program. Since it moreover has an editor function 
in which edit of contents can be performed in a hourly base, contents with high flexibility can be 
easily created beyond the conventional art. 

[0090]The object (for example, clock which the male in dra w i n g 2 has stuck) in the animation 
specified by the synchronization attribute information of the direction of space in the above- 
mentioned embodiment, The rectangular area (refer to the rectangular area 19 of drawing 2) 
pinpointed by the hour entry (time code) showing the time playback position of an animation, the 
coordinate information showing the coordinates position in a frame, and the size information 
showing a size in every direction has prescribed. However, it is also possible to specify the 
object (for example, the clock itself) of arbitrary gestalten itself. In this case, the form of an 
object will be specified in the field of the polygon more than a rectangular head. 
[0091]When setting [ the above-mentioned embodiment ] up the synchronization attribute 
information of the direction of space to one certain object, in order to give the time margin in 



JP.2002-176638.A [DETAILED DESCRIPTION] 



12/14 1— is 



which a mouse click is possible to some extent to a user, It is necessary to set the 
synchronization attribute information of the direction of space as the position of the object over 
a multiple frame. In that case, it also needs to change the synchronization attribute information 
of the direction of space for every frame in order to change for every frame although the 
position of an object is an animation therefore. Especially when it specifies an object not 
according to a rectangle but according to that outside, the preparing work of this 
synchronization attribute information will become complicated. 

[0092]On the other hand, the art of image recognition in which it is used, for example with the 
surveillance camera etc. is applied, It is also possible by image recognition time and to follow 
automatically spatially and to specify in the object which specifies arbitrary objects with the 
specific frame in an animation, makes a system recognize this, and moves on an animation with 
other frames. 

r0093l Drawing 8 is a block diagram showing the example of functional constitution with which the 
contents creation client 3 in this case is provided. In drawing 8, the video data storage parts 
store 51 memorizes the video data made into the object which makes scenario information. The 
object specification part 52 takes out the arbitrary frames (for example, the first frame in which 
arbitrary objects appear) 55 in the video data memorized by the video data storage parts store 
51, and performs processing which specifies the arbitrary objects in it. As the outline of a 
desired object is bordered, specifically, the outside of an object is specified. 

[0094]The image recognition section 53 takes out other frames 56 other than frame 55 taken out 
with the above-mentioned object specification part 52 out of the video data memorized by the 
video data storage parts store 51, and detects and specifies the object specified [ above- 
mentioned ] by processing image recognition out of each frame 56. At this time, extraction of the 
object concerned is not performed about the frame in which the same object as the object 
specified with the object specification part 52 does not exist. 

[0095]Thus, the spatial position within the frame concerned of the object in the frame 55 
specified by the object specification part 52, The spatial position within the frame concerned of 
the object in each frame 56 specified by the image recognition section 53 is memorized by the 
scenario information storage parts store 54 as position information on scenario information. The 
time position of each frame is memorized by the scenario information storage parts store 54 as a 
hour entry of scenario information. The scenario information memorized by this scenario 
information storage parts store 54 is registered into scenario DB6 of the scenario server 1 via a 
network after that. 

[0096] Since a system will generate automatically the synchronization attribute information ot the 
direction of space in the other frame if arbitrary objects will be specified with arbitrary frames if 
it does in this way, and the synchronization attribute information of the direction of space is set 
up, the load of the preparing work of scenario information is substantially mitigable. 
[0097]At the time of creation of scenario information, an object is specified only to the arbitrary 
frames in an animation, the synchronization attribute information of the direction of space is set 
up and this is registered into the scenario server 1. And when actually distributing an animation, 
according to image recognition, it follows automatically, the object which moves for every frame 
is specified, and it may be made to set up the synchronization attribute information of the 
direction of space one by one by this about other frames. In this case, data volume registered 
into the scenario server 1 can be lessened. 

[0098]If the outside of the object which moves on an animation is specified with polygonal data, 
the data creation at the time of defining the outside of an object (work which borders the outline 
of an object) will become difficult. If the accuracy of image recognition is raised, data volume will 
increase, the amount of data transmitting occupied by scenario information other than a video 
data will increase, and transmission speed will become slow. Therefore, it is also possible to 
recognize an object for the object which moves on an animation from the prescribed point and 
its amount of vectorial transfer on not polygonal data but an object. In this embodiment, it is also 
possible to recognize the position information on an animation object by arbitrary methods other 
than polygon data or the amount of vectorial transfer. 

[0099]Although a video data and scenario information were independently distributed to the 
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client from the server and the example which carries out the multiplexer of these and is 
reproduced by a client side was explained by an above embodiment, The multiplexer of a video 
data and the scenario information is carried out, and it may be made to transmit by the server 
side, as shown in drawing 9 . 

[0100]That is, in the example of drawing 9 , the server 10 side is equipped with the multiplexer 
part 61, and the multiplexer of a video data and the scenario information is carried out here, and 
it transmits. In exclusive player 8' by the side of client 4 _ 1 and 4 _ 2 , the video data and scenario 
information which have been sent by carrying out a multiplexer are reproduced according to the 
attribution information within a scenario. 

[01 01] Although here showed only drawing 9 as a modification over drawin g 1, the multiplexer of a 
video data and the scenario information is carried out, and it may be made to transmit by the 
server 10 side similarly in the application shown in drawing 4 - drawing 7 . 
[0102]As shown in drawing 10 , the real-time encode part 62 may be formed between the 
animation server 2 and the multiplexer part 61. In the example of drawing 9 , in the contents 
creation client 3, a video data and scenario information are encoded independently, in the 
multiplexer part 61, the multiplexer of encoded a video data and scenario information is carried 
out, and they are distributed. On the other hand, in the example of drawing 10 , at least about an 
animation, when distributing to client 4 _ 1 and 4 _ 2 , it encodes in real time by the real-time 

encode part 62. 

[0103]Encoding said here is encoding which used the variable rate function of the MPEG 
standard, for example. By encoding using this variable rate function, the transfer rate of a video 
data is changeable into real time according to the throughput by the side of client 4 _ 1 and 4 _ 2 , 
the line speed on a processing load or a network, etc. This becomes possible [ the thing / 
sometimes coming out and distributing a video data with the optimal transfer rate ] from a 
viewpoint of the image quality of a video data, and a transfer rate. 

[0104]As shown in drawin g 1 1 , the real-time encode part 63 may be formed in the latter part of 
the multiplexer part 61. In the example of this drawing 11, to data after carrying out the 
multiplexer of a video data and the scenario information, when distributing this to client 4 _ 1 and 
4 _ 2 , it encodes in real time by the real-time encode part 63. Encoding said here is also encoding 
using the variable rate function of the MPEG standard. 

[0105]In the case of drawing 10, although encoding by a variable rate was performed only to the 
video data with larger data volume and large transfer loads, in the example of drawing 11, a 
variable rate is encoded to the both sides of a video data and scenario information. Thereby, 
according to the occasional processing load, line speed, etc., it can distribute with the optimal 
transfer rate about all the data distributed to client 4 _ 1 and 4 _ 2 . 

[0106]The data communication system of this embodiment described above comprises a CPU of 
a computer or MPU, RAM, a ROM, etc., and when the program memorized by RAM and ROM 
operates, it can be realized. Therefore, the program operated so that a computer may achieve 
the above-mentioned function is recorded, for example on a recording medium like CD-ROM, and 
can be realized by making it read into a computer. As a recording medium which records the 
above-mentioned program, a floppy (registered trademark) disk, a hard disk, magnetic tape, an 
optical disc, a magneto-optical disc, DVD, a nonvolatile memory card, etc. can be used in 
addition to CD-ROM. 

[0107]The function of an above-mentioned embodiment is not only realized by executing the 
program to which the computer was supplied, but, The case where the function of an above- 
mentioned embodiment is realized in collaboration with OS (operating system) or other 
application software etc. with which the program is working in a computer, Also when all or a 
part of supplied processing of a program is performed by the expansion board and function 
expansion unit of a computer and the function of an above-mentioned embodiment is realized, 
this program is included in the embodiment of this invention. 

[0108]It performs by computers of all [ or ] of others [ programs / a part of ] in order to use this 
invention by a network environment. 
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[0109]In addition, each embodiment described above is only what showed an example of the 
embodiment which hits that each carries out this invention, and the technical scope of this 
invention must not be restrictively interpreted by these. That is, this invention can be carried out 
in various forms, without deviating from the pneuma or its main feature. 

[0110] 

[Effect of the Invention]According to this invention, it not only reproduces other contents, taking 
a synchronization in time with a video data, but [ as explained above ], Synchronous 
reproduction to the direction of space of reproducing other contents corresponding to operation 
of directing the spatial specific position set up in the video data etc. can also be performed now. 
Thereby, it is more complicated and variegation and interactive bidirectional animation 
communication with large flexibility can be realized easily. 

[01 1 1]Since according to other features of this invention a video data and scenario information 
are prepared independently and it distributes independently, and a multiplexer is carried out and 
it reproduces by the client side of a distribution destination, The contents of contents can be 
changed only by rewriting scenario information, and it cannot be asked whether it is under 
[ animation distribution ] ******, but real time contents edit can be performed easily. 



[Translation done.] 
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* NOTICES * 

JPO and INPIT are not responsible for any 
damages caused by the use of this translation. 

1. This document has been translated by computer. So the translation may not reflect the original 
precisely. 

2. **** shows the word which can not be translated. 
3.1n the drawings, any words are not translated. 
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[Brief Description of the Drawings] 

[D rawing 1] It is a figure showing roughly the example of composition of the whole data 
communication system by this embodiment. 

[Drawing 2] It is a figure showing the example of the display screen of a client. 

[Drawing 3]It is a block diagram showing the detailed example of functional constitution of a 

scenario server, an animation server, and an exclusive player shown in drawing 1 . 

[Drawing 4]It is a figure showing the example of an entire configuration of the common contents 

preparing system adapting this embodiment. 

[Drawing 5] It is a figure showing the example of an entire configuration of the multi- 
communication system adapting this embodiment. 

[Drawing 6]It is a figure showing the example of an entire configuration of the multi- 
communication system adapting this embodiment. 

[Drawing 7] It is a figure showing the example of an entire configuration of the user participation 
type contents preparing system adapting this embodiment. 

[Drawing 8] It is a block diagram showing the example of functional constitution with which a 
contents creation client is provided. 

[Drawing 9] It is a figure showing roughly other examples of composition of the whole data 
communication system by this embodiment. 

[Drawing 10]It is a figure showing roughly another example of composition of the whole data 
communication system by this embodiment. 

[Drawing 1 1]It is a figure showing roughly another example of composition of the whole data 
communication system by this embodiment. 
[Description of Notations] 

1 Scenario server 

2 Animation server 

3 Contents creation client 

4 Client 

6 Scenario DB 

7 Animation DB 

8 An exclusive player 

1 0 Server 

1 1 Interactive player 

1 2 The browser window of a text 

13 Browser window 

1 4 Other windows 

15 Animation display field 

16 The manual operation button of rewinding, reproduction, a halt, a stop, and a rapid traverse 

17 Slide bar 

18 Bar 

19 The rectangular area pinpointed by the synchronization attribute information of the direction 
of space 
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20 Function button 

31 Web server 

32 The interface of TCP/UDP 

33 Scenario creation control section 

34 DB access part 

35 Client access control section 

36 Scenario edit control part 

37 File reading unit 

38 Separation part 

39 Animation decode part 

40 Voice decode part 

41 Animation control section 
42a Animation display layer 

42b Mouse detecting position layer 

43 The interface of TCP/IP 

44 Synchronization-attribute-information storage parts store 

45 Mouse operation analyzing parts 

46 Motion-control part 

51 Video data storage parts store 

52 Object specification part 

53 Image recognition section 

54 Scenario information storage parts store 

61 Multiplexer part 

62 and 63 Real-time encode part 
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